a: 

f  r  > 

10 

oc 


RESEARCH  AND  DEVELOPMENT  PROJECT 
PRIORITIZATION  -  COMPUTER  MODEL 


Edward  B.  Dobbins.  Jr. 
Technology  Integration  Office 
US  Army  Missile  Laboratory 


r- 

V 


April  1M0 


HD.S.ABW  MtSStLl  CtMMAK)® 

F*»c/mton4*  Ar»«naf,  A/abama  MfOf 


Approved  for  public  release/  distribution  unlimited 


If  ll  761- 


m  Fomi  mi,  i  jul  n  pneviou*  coition  is  omolctc 


Best  Available  Copy 


6  17  024 


Best 

Available 

Copy 


DISPOSITION  INSTRUCTIONS 


OESTROY  THIS  REPORT  WHEN  IT  IS  NO  LONGER  NEEDED  DO  NOT 
RFTURN  IT  TO  THE  ORIGINATOR 


DISCLAIMER 

THE  FINDINGS  IN  THIS  REPORT  ARE  NOT  TO  BE  CONSTRUED  AS  AN 
OFFICIAL  DEPARTMENT  OF  THE  ARMY  POSITION  UNLESS  SO 
DESIGNATED  BY  OTHER  AUTHORIZED  DOCUMENTS 


TRADE  NAMES 

USE  OF  TRADE  NAMES  OR  MANUFACTURERS  IN  THIS  REPORT  DOES 
NOT  CONSTITUTE  AN  OFFICIAL  ENDORSEMENT  OR  APPROVAL  OF 
THE  U8E  OF  SUCH  COMMERCIAL  HARDWARE  OR  SOFTWARE. 


Best  Available  Copy 


REPORT  DOCUMENTATION  PAGE  |  be^SSJSSS'S*- 


>«  REPORT  NUMBER  j2.  GOVT  ACCESSION  NO.}  *  RECIPIENT'S  CATAlOS  NUMBER 

V 


4  TITLE  fan* 

Research  and  Development  Project  Prioritization  - 
Computer  Model* 


7.  AUTHOR) 

Edward  B.  /bobbins,  Jr? 


V-*.ype  or  report  a  period  covered 


*  PERFORMING  o 


•  contract  or  GRANT  NUMBER*} 


9.  PERFORMING  ORGANIZATION  NAME  AnO  ADDRESS 

Commander 

US  Army  Missile  Command 
ATTN:  DRSMI-KK 
Redstone  Arsenal*  Alabama  358 


11.  controlling  office  NAME  and  aooress 
Commander 

US  Army  Missile  Cctmuind 

ATTN:  DRSMI-RPT 

Redstone  Arsenal*  Alabama  35809 


IS.  DISTRIBUTION  STATEMENT  ft  Air  JUport) 


NUMBS*  OF  PAGES 

255 


is.  SECURITY  CLASS,  (ot  tSi,  n*o<i) 


Approve d  for  public  release;  distribution  unlimited. 


19.  KEY  BOROS  (Continuo  on  r*»«rM  mt4*  tf  nococoorf  oej  tdontlty  Sr  Nock  axa&o*} 

Aggregation  fuzzy  Set  Rank  Orders 


Research  and  Development 
Prioritization 
Computer  Model 


Aggregation  fuzzy  Set  Rank  Orders  Social  Choice 

»«.  Ci<iua  Majority  Rule 

Research  and  Developaent  Circular  Triads 

Prioritization  Consistency 

Computer  Model  Concordance 


2-  'ABSTRACT  (GMt  MMMWM  ms  Jf  m  c»  t— j  w  Momtlfy  *r  Mock  m mnm) 

This  report  is  based  upon  research  concerned  with  the  a;.gregatior.  of 
multiple  lists  cf  rank  ordered  research  and  developaent  (R&D)  projects  or 
product  requirements  needing  R&D.  The  resultant  prioritized  list  serves 
as  a  basis  for  resource  allocation  to  the  R&D  projects.  The  rank  orders 
are  ordinal  and  without  feedback  or  strategy.  The  model  and  computer  code 
use  validated  methods  to  compute  the  aggregation  of  up  to  100  rank  ordered 
lists  of  up  to  100  alternatives.  Final  lists  are  computed  by  the  Shannon, 
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I.  INTRODUCTION 

A-  Statement  of  the  Problem 

The  problem  addressed  in  this  report  and 
Dobbins  (4,5)  is  to  develop  and  demonstrate  a  method¬ 
ology,  with  its  associated  computer  model,  that  will 
acceptably  transform  several  individual  multiple cri¬ 
teria  rank  ordered  lists  of  research  and  develop¬ 
ment  (RtD)  projects  into  a  single  aggregated,  priori¬ 
tized  rank  ordered  list  to  guide  the  investment  of 
RsD  resources.  In  addition,  provisions  are  needed 
for  the  individual  lists  to  be  converted  from  various 
formats.  Decision-maker  and  judge  self-rating 
weighting  methodologies  are  necessary.  The  method¬ 
ology  developed  must  be  capable  of  aggregating,  with 
reasonable  effort,  very  long  individual  partial 
length  and/or  full  lengto  litis.  Over  fifty  alter¬ 
natives  should  be  allowed  in  the  full  length  lists. 
This  report  describes  the  computer  model  for  the 
research. 


3.  Seed  for  This  Research  Solution 

The  task  of  R4D  management  planning  for 
high  technology  systems  has  become  sore  difficult. 

The  eaphasis  cn  coordination  and  communication  be¬ 
tween  the  management  of  aagor  functional  elements  of 
high  technology  systems  developmental  organiza¬ 
tions,  both  industrial  and  governmental,  and  the  ex¬ 
panded  usage  of  goal  and  objective  planning  net nods 
have  complicated  the  planning  process.  Situations 
have  resulted  wh  re  the  planners  in  the  RiD  element 
receive  many  diverse  priority  lists  of  suggested 
future  work  or  products  from  the  other  functional 
elements  (i.e.,  marketing,  field  operations,  produc¬ 
tion,  and  senior  staffs)  and  from  managers  within  the 
RiD  organization.  The  prioritization  criteria  of 
interest  to  each  contributing  decent  differ  as  their 
functions  and  objectives  differ.  Therefore,  the  indi  • 
vidual  prioritizations  will  be  based  to  sose  extent. 
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upon  the  objective  criteria  and  viewpoints  of  each 
element.  The  RAD  element  management  must  combine 
these  lists  into  a  usable  list  o*  prioritized  RsD 
projects  for  their  consideration  in  the  allocation 
of  discretionary  BSD  funds  toward  advancing  the 
technology  base  of  the  enterprise. 

As  a  specific  exasple,  the  director  of  the  US 
Ancy  Miss' le  Laboratory  has  such  a  planning  need. 

Each  year  he  selects  and  funds  at  least  100  BSD  tasks 
with  over  $50  Billion.  The  Arzy  policy  of  Single 
Prog ran  Eleaent  Funding  (SPEF)  gives  to  the  labora¬ 
tory  director  the  final  discretion  to  establish  the 
most  productive  and  best  balanced  prog  ran.  The 
director  is  provided  an  abundance  of  advice  iron 
outside  and  within  his  laboratory.  The  advice  is 
usually  in  the  form  of  lists  of  RAD  tasks  or  required 
products  to  which  he  should  give  higher  priority  and 
thereby  funding.  To  advise  the  Arxy  Missile  Labora¬ 
tory  d  rector,  and  his  counterpart  at  other  Any  RsB 
laboratories,  the  user  staff  agencies  of  tie  Arsy, 
the  Deputy  Chief  of  Staff  for  Operation  ID CS)B)  and 
the  Training  and  Doctrine  Cossand  {TEA DOC) ,  annually 
prepare  documentations  containing  their  priority 
rankings  of  potential,  not  yet  developed  military 


materiel.  The  TRAOQC  list  gives  a  rank  order  number 
to  each  future  system.  The  DCSO?  docasent.  called 
the  Science  and  Technology  Guide  (STOG)  groups  the 
potential  future  aateriei  systems  into  unranked  cap¬ 
ability  category  classes  of  use:  i-e..  Air  Defense, 
Close  Cosbat,  Fire  Support,  etc-  Within  each  cap¬ 
ability  category  the  potential  future  systems  are 
rank  ordered.  The  laboratory  directors  must  relate 
each  SAD  project  technology  task  to  the  one  or  sore 
potential  future  systems  to  which  it  could  lead. 

Three  headquarters  organizations,  the  Depart¬ 
ment  of  Defense  (DOD) ,  the  Department  of  the  Amy 
(DA},  and  the  Develocsieat  and  Readiness  Command 
(DAS COM) ,  as  well  as  the  US  Congressional  staff  all 
have ,  on  occasion,  sent  letters  to  the  director 
ret unwinding  funding  of  certain  selected  tasks  or 
groups  of  tasks  within  the  director’s  S?5  program. 
Tri-Service  special  topic  coseittees  prepare,  and 
often  prioritize,  lists  of  SAD  project  tasks  which 
they  recossend  for  increased  funding.  Amy  missile 
RAD  technology  often  is  included  in  the  Tri-Service 
coasittee  lists.  The  local  cossander’s  staff  also 
provides  a  rank  ordered  list  of  sys'.ess  tc  be 
supported  by  the  laboratory’s  RsD  technology  efforts. 
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Often  the  cos~ander ,  who  supervises  the  laboratorv 
director,  has  a  few  RO  technology  projects  or  poten¬ 
tial  applications  that  ht  believes  stasis  be  given 
special  attention  and  resources-  within  the  Arc/ 
Missile  Laboratory,  task  priority  rankings  are  pre¬ 
pared  by  the  director's  staff  and  by  subordinates  of 
the  directorates  and  otf.cers  of  the  laboratory.  The 
laboratory  director  msst  allocate  his  discretionary 
fanes  to  the  HiO  technology  projects  that  will  pro¬ 
duce  the  cost  return  on  its  investment  by  the  Any 
and  maintain  the  viability  of  the  laboratory.  5e 
nest  give  appropriate  managerial,  tech-^cai,  and 
political  weight  to  each  of  the  recosaeadat ions  of 
his  advisors. 

The  preceding  statement  of  need  and  the  exam¬ 
ple  can  be  resolved  into  the  need  for  a  methodology 
for  aggregation  of  multiple  criteria  rank  ordered 
priorities. 

C.  Scoot  of  This  Research 

The  research  documented  by  this  report  and 
Dobbins  (4.5)  is  based  coca  a  cosprehens i~e  litera¬ 
ture  survey  on  the  subject  of  social  choice  and 


majority  rule  methods  that  ara  apclicaole  to  the 
aggregation,  without  feeuback,  of  multiple  criteria 
rank  ordered  ordinal  priorities,  free  th»s  basis, 
the  research  determined  and  developed  the  specific 
majority  rule  net hods logy  to  aggregate  the  tariet/ 
rank  ordered  priority  lists,  as  described  previous, 
for  Rs3  project  priority  determination.  The  chosen 
majority  rule  methodology  is  integrated  by  an  aggre 
cation  logic  model  that  satisfies  the  following 
regu  i  resents  ; 

I )  Aggregate  rank  ordered  individual 
sublists  which  have  any  or  all  of  the  following 
features! 

a)  Complete  length  lists  of  ap  to 
100  alternatives  that  rank  all  possible  projects  or 
regui resents  for  products. 

j!  Reduced  length  lists  { down  to 
two  alternatives)  that  rank  less  than  the  complete 
set  of  possible  projects  or  reouiresents. 

c)  Transitive  rank  ordered 

sshlists. 
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c|  Sesi  ordered  and/or  stro^ly 
ordered  (X  >  T  and/or  X  >  Tj  ssbiists. 

e|  Catrcsriiec  grwniss  scbiists, 

» he  re  oae  of  the  foilwisq  say  occur: 

ill  The  projects  are  subdivided 
into  categories.  Ties,  vitbia  each  category,  the 
projects  are  racked,  hot  the  categories  say  or  say 
not  be  strongly  ranked. 

12}  the  projects  are  subdivided 
into  categories.  Thus,  the  categories  are  ranked, 
hat  the  projects  within  a  category  say  or  say  not  be 
strongly  ranked. 

£1  Ssltiple  sohiists  ranked  in 
accordance  with  a  cesses  criteria  or  within  indivi¬ 
dual  criteria. 

gl  Sohiists  where  the  alternatives 
are  ordinal  ranked  basti  epos  various  foms  of 
cardinal  utilities  sue.;  as: 


(2#  The  date  that  the  usable 
sateriel  product  : res  the  will  he  available. 

2)  Xeight  the  importance  and  aathenri- 
city  of  each  sub  I :sr  during  lie  aggregation  s-rooess. 
Ttse  types  of  weighting  sechanisss  include  the 
following: 

a}  Dec is ion-cake r  weighting  ©echar 

isss  to  he  applied  to  single  alternative  and/or  to 
the  snhlists  ranked  by  certain  judges.  The  sechan- 
isss  will  include  ssltiplicatlve  factors  and  expone- 
tial  factors. 

b>  Jodge  self— expertise  weighting 
where  each  jodgt  will  rate  his  ©wo  expertise  co  each 
alternative. 

3|  Analytically  measure  and  statisti¬ 
cally  test  the  concordance  of  each  sshlist  rani  3rd-: 
and  the  consistency  of  the  aggregate  rank  order - 

The  logic  node I  was  converted  into  a  digital 
soupater  code  to  perfess  the  preceding  regu i renencs 
for  up  to  ICO  rank  order  alternatives. 


(11  Value  estivates 


:or  this  prior 2 1 rank 


method  can  se  real- 


iSss  chaster-  gives  a  ssasary  discrssios  cf  the 
cc==star  cede  issieseatatiss  of  the  ordinal  rank 
order  aggregation  model  described  is  Dobbins  fa*. 

Ihe  programming  computer  code  structure  is  described 
and  the  wstpet  data  format  is  briefly  discussed. 
Extensiw*  instructions  as d  exanpse  cozputer  problems 
wave  documented  is  detail. 

A-  Gassier  x&del  iSvelcsaeot  Overview 

’-he  aggregation  of  sultiole  criteria  rank 
ordered  priorities  too** i  presented  is  Dobbins  (4)  was 
implemented  in  Extended  rOKTSAU,  Version  4,  os  the 
CSC  CT5EH  74.  The  count ter  used  the  J30S/3E  executive 
pnsgias  and  has  a  400,0*0  octal  space  capacity  in  its 
central  memory-  The  computer  facility  is  located  in 
the  Scientific  and  Engineering  Divisicn  of  the  Kan- 
agement  Information  System  Division  of  ^  rjg  Ar3Ey 
JSissile  Concasd  'SICOr’i,  aedstose  Arsenal,  Alabama. 

The  code  was  developed  as  asi  experimental  pro¬ 
gram;  therefore,  achievement  of  its  maximum  matrix 
size  was  not  a  major  consideration.  The  fall  poten¬ 


tial 

i zed  when  its  matrix  aiMMicns  are  re— optimized  for 
the  appi ied  problem  of  PiD  project  prioritization. 
Instead  of  the  present  100  x  100  matrix  dimension, 
the  more  practical  dimension  nay  be  on  the  order  of 
50  x  20C  tSG  lodges  with  op  to  200  alternatives J . 

The  code  design  was  modularized  through  the 
cse  of  subprograms  to  facilitate  phased  development, 
ref i resents  during  research,  verification,  and  vali¬ 
dation.  The  thirteen  subroutine  programs  will  be 
described.  Since  the  design  goal  of  the  model  was  to 
fora  and  manipulate  up  to  100  x  100  element  matrices 
and  to  aggregate  one  time  suolists,  the  batch  proces¬ 
sing  code  of  computation  was  chosen  as  the  most 
practical. 

5.  Computer  Kodel  Code  Description 
i.  Overall  Computer  ?5©de!  Steps 

The  computer  model  for  this  research 
requires  large  computer  core  storage  space  but  oper¬ 
ates  very  rapidly  since  it  does  not  use  iterative 
calculations.  Further,  the  model’s  code  design 


emphasized  flexibility  of  progran*in :  options  as  well 
as  future  operational  f  lexiril  ity  to  moot  and  aggre¬ 
gate  a  wide  variety  t;  s&siist  priority  order  styles 
Generated  f rod  many  linking  criteria. 

The  flexibility  of  the  sodel  encompasses  tne 
wide  variety  of  subl  st  formats  tnat  have  been  antic¬ 
ipated,  such  as  reqa  resents  1 ists,  expected  opera¬ 
tional  dates,  card :r,  1  data,  and  the  desire  to 
develop  methodology  oals  to  permit  exploration 
research  in  such  are  is  as  tossy  set  rank  orders,  pre¬ 
ference  scoring  cons  .ants,  and  comparative  aggrega¬ 
tion  methodologies.  The  comparative  methodologies 
include  the  3orda,  adjusted  Borda,  and  the  Shannon 
preference  majority  rule  setheds. 


such  as  the  natr.x  scoring  constants  ana  tae 
type  for  the  rsir  .  Typical  sual  ist  controls  ar- 
al ter native  ice: tif icat ions  and  weights-  The  :ti-' 
also  reads  suol ist  data  su-h  as  the  ranks  and  - 
evaluation  values. 

Found  w.thin  the  input  senorograa.  Put  frac¬ 
tionally  separate,  is  the  conversstwi  os  toe  input 
sublist  alternative*  to  a  standard  for*.  This 
neludes  conversion  of  cardinal  scares  aitertia::.-- 
to  an  ordinal  ranking  or  the  conversion  of  categor¬ 
ized  alternatives  into  single  rank  ordered  lists. 
Alternative  is  emphasized  at  this  phase  is  toe  - 
since  the  ranked  eleaents  can  be  either  SsS  prr. 
or  product  requirements. 


(a)  Flow  Diagram 


Figure  1  contains  a  simplified 
colei  flow  diagram.  A  most  comprehensive  module  is 
the  input  subroutine.  This  block  of  the  code  inputs 
and  stores  the  req- irements-to-projects  translation 
equivalency  statements  that  are  expected  tc  be  used 
for  a  number  of  ru  is.  The  input  also  reads  and 
assigns  the  run  ard  sublist  control  codes  for  actions 


•here  alternatives  are  product  rettirrsisi-;, 
the  next  phase  is  to  translate  those  sablists  of  rm 
ordered  requirements  into  translative  sshlist-s  of 
rank  ordered  SiD  projects. 

At  the  completion  of  the  injwt,  e«vers»cvi. 
and  translation  phase,  all  subsists  are  re- dv  *j 
enter  the  matrix  aggregation  ia  a  standard  for*  s* 
transitive  rank  ordered  lists  of  =iiD  or~ -r 
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Initially  in  this  second  phase,  the  sublists 
become  sublist  frequency  matrices  scored  by  the 
chosen  constants.  The  same  standardized  sublists  are 
used  to  calculate  and  test  the  statistical  signifi¬ 
cance  of  the  coefficient  of  concordance. 

If  weighting  and/or  judge  self-evaluation  are 
included  for  the  run,  the  sublist  matrix  elements  are 
next  normalized  by  multiplication  by  four  and  then _ 
weighted.  At  this  phase,  the  judge  self-evaluation 
factors  become  another  multiplicative  weight. 

The  sublist  matrix  elements,  either  all 
weighted  or  unweighted,  are  summed  into  the  summed 
frequency  matrix  which  contains  the  sura  of  votes,  or 
weighted  votes,  that  each  alternative  received  when 
paired  against  each  other  alternative.  If  there  is 
no  judge  indifference,  the  sum  of  the  values  in  each 
row  element  become  the  Borda  count  for  the  row  (pro¬ 
ject).  With  or  without  judge  indifference,  the  sum 
of  the  row  element  values  minus  the  sum  of  the  column 
element  values  is  the  adjusted  Borda  count.  The 
model  rank  orders  these  counts  into  the  Borda  and 
adjusted  Borda  rank  orders. 
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The  summed  frequency  matrix  element  values, 
divided  by  the  number  of  judges,  becomes  the  fuzzy 
matrix,  R.  From  R,  the  model  calculates  the  fuzzy 
measures,  F(R)  and  C(R),  and  the  fuzzy  rank  order. 

The  comparison  of  the  complement  paired  ele¬ 
ment  values  in  the  summed  frequency  matrix  is  the 
basis  for  element  values  in  the  preference  matrix. 

The  preference  matri::  assigns  scores  to  projects  for 
the  number  of  majority  comparisons  they  win,  tie,  or 
lose.  The  sum  of  the  row  element  values  provides  the 
aggregation  count  for  each  project.  The  model  rank 
orders  this  count  into  the  aggregation  rank  order. 

The  preference  row  counts  also  provide  the 
inputs  for  the  calculation  of  the  number  of  circular 
triads,  D,  and  the  coefficient  of  consistency,  zeta. 
The  mcdel  tests  the  statistical  significance  of  zeta. 

Last,  the  model  can  compare  any  chosen  combi¬ 
nations  of  the  final  rank  orders  (Borda,  adjusted 
Borda,  fuzzy,  or  preference)  then  determine  and  test 
the  Kendall's  coefficient  of  concordance  for  these 
rank  orders. 


The  appendix  contains  a  more  comprehensive 
model  functional  flow  diagram  which  contains  major 
decision  logic  nodes. 

(b)  Subroutine  Programs 

The  appendix  contains  the  list¬ 
ing  with  definitions  of  key  terms  for  the  aggregation 
of  multiple  criteria  rank  crder  priorities  computer 
code,  developed  for  the  dissertation  research.  The 
code  structure  diagrammed  in  Figure  2  consists  of  the 
main  program  and  thirteen  subroutine  program  modu.’es 
as  follows t 

(1)  Main  Program  -  DOBBINS  - 
The  main  program  coordinates  all  mainstream  proces¬ 
sing  of  rank  orders  through  the  model.  It  calls  sub¬ 
routines  in  the  proper  sequence  for  calculations  in  a 
given  run  based  on  user  and  model  provided  controls 
and  data.  It  writes  only  the  summed  frequency  matrix 
and  the  Borda-type  counts  and  rank  orders. 

(2)  Subroutine  INPUT  -  The  sub¬ 
routine  reads  and/or  coordinates  the  input  controls 
and  data.  The  subroutine  also  converts  the  sublist 


alternative  data  to  the  standard  ordinal  rank  order- 
format.  INPUT  reads  the  run  controls  and  the  sublist 
controls.  It  coordinates  the  calling  of  subroutine 
PRAM  which  reads  sublist  ranks,  weights,  and  self- 
evaluation  data.  The  self-evaluation  rating  full 
scales  are  converted  to  0  to  1  and  the  specified 
sublist  conversions  JCONV  2  to  12  are  performed  in 
INPUT.  This  subroutine  applies  the  self-evaluation 
threshold  and  checks  all  subroutines  for  completion. 
Finally  it  stores  the  converted,  unweighted  standard 
form  sublists  of  ranked  alternatives. 

(3)  Subroutine  PRAM  -  This  is 
library  subroutine  to  enter  floating  point  data  in 
free  format  form  where  precise  formats  are  not  prac¬ 
tical.  In  this  computer  model,  PRAM  is  used  to  enter 
the  sublist  rank  data  and  the  self-evaluation  data. 

(4)  Subroutine  REQUIRE  -  This 
subroutine  receives  converted  requirements  sublists 
from  INPUT.  It  compares  each  sublist  to  the  transla¬ 
tion  index  that  has  been  sorted  and  arranged  by  re¬ 
quirement  name.  REQUIRE  then  extracts  the  projects 
that  match  the  requirement  in  the  sublist.  A  pro¬ 
ject's  rank  order  is  built  by  insertion  of  the  group 


of  projects  for  each  requirement.  REQUIRE  purges 
dup1 ’cations  from  the  raw  projects  rank  order.  The 
transitive  project  sublist  is  returned  to  INPUT. 

(5)  Subroutine  FREQ  -  This 
subroutine  coordinates  the  placement  of  the  sublists 
into  sublist  frequency  matrices  and  the  weighting  of 
the  frequency  matrix  elements.  It  further  applies 
the  self-evaluation  values  to  the  frequency  matrix 
elements  and  writes  the  sublist  self-evaluation  fre¬ 
quency  matrix. 

(6)  Subroutine  MATRIX  -  This 
subroutine  forms  and  writes  the  sublist  frequency 
matrix  for  each  sublist.  The  matrices  are  formed 
using  the  specified  matrix  scoring  constants. 

(7)  Subroutine  WEIGHT  -  This 
subroutine  applies  the  specified  weighting  to  each 
sublist  frequency  matrix  element  and  writes  the 
weighted  sublist  frequency  matrix.  Before  any 
weights  are  applied*  WEIGHT  multiplies  all  sublist 
matrix  elements  by  four. 


(8)  Subroutine  PREF  -  This 
subroutine  forms  and  writes  tne  preference  matrix, 
calculates  the  number  of  circular  triads,  D,  and 
the  coefficient  of  consistency,  zeta,  and  statisti¬ 
cally  tests  zeta.  The  subroutine  also  calculates  the 
bracket  and  average  values  for  D  and  zeta  when  frac¬ 
tional  sums  occur  in  the  preference  matrix  rows.  All 
D,  zeta,  and  test  results  are  written  by  this  sub¬ 
routine.  The  matrix  is  formed  using  the  specified 
matrix  scoring  constants. 

(9)  Subroutine  MUCH  -  This 
subroutine  is  an  International  Mathematical  and 
Statistical  Libraries  (IMSL)  program  which  is  used 
for  the  chi-squared  probability  statistical  tests  of 
the  Kendall  coefficient  of  concordance  and  the 
coefficient  of  consistency.  MUCH  automatically 
changes  to  use  the  normal  distribution  approxima¬ 
tion,  Z,  for  the  high  degrees  of  freedom  with  the 
chi-square  statistic,  (df  >  30) 

(10)  Subroutine  ORDER  -  This 
subroutine  converts  a  list  of  values  for  a  set  of 


alternatives  into  an  ordinal  rank  ordered  list  of  the 
alternative  identifications.  CRDER  writes  the  final 
rank  order  list. 

(11)  Subroutine  FUZZY  -  This 
subroutine  calculates  the  fuzzy  matrix,  the  measures 
F(R)  and  C(R),  and  writes  the  Fuzzy  project  scores. 
This  subroutine  coordinates  the  forming  and .writing 
of  the  Fuzzy  rank  order  list. 

(12)  Subroutine  CONCOR  -  This 
subroutine  calculates,  statistically  tests,  and 
writes  the  results  of  the  coefficient  of  concordance 
for  the  standard  sublists.  CONCOR  also  calculates 
and  writes  the  intermediate  concordance  variables 
such  as  the  mean  and  the  sum  of  the  squares  of  the 
deviations  from  the  mean. 

(13)  Subroutine  COMPARE  -  This 
subroutine  takes  the  final  aggregate  rank  orders 
from  the  BORDA,  ADJUSTED  BORDA,  PREFERENCE,  and,  if 
available,  FUZZY  methods  and  compares  them  two  at  a 
time.  The  pairs  of  aggregated  lists  are  sent  to 
CONCOR  and  evaluated,  then  return  to  COMPARE.  When 


the  last  pair  is  evaluated  COMPARE  returns  to  the 
main,  DOBBINS,  and  the  program  terminates. 

2.  Input  to  the  Computer  Model 
(a)  Overview 

The  inputs  to  this  computer  code 
have  been  kept  relatively  simple  compared  to  the 
complexity  of  the  model.  Inputs  are  the  run  control;, 
and  alternative  names,  the  ranking  and  rating  data 
entered  in  free  form. 

lb)  Option  Control 

Besides  the  alternative  names 
and  numbers,  the  first  set  of  cards  (one  card  per 
alternative)  contain  the  alternative  weight  factors 
and  category  for  that  alternative.  The  second  type 
of  single  control  card  has  integer  numerical  digits 
to  designate  the  type  of  weighting  technique  (one 
through  eight),  whether  the  sublists  should  be  com¬ 
pleted,  the  type  of  matrix  scoring  constants  for 
both  the  frequency  and  preference  matrices,  the 


self-evaluation  control  for  weighting  or  weighting 
and  threshold  elimination,  and  the  self-evaluation 
scale  limit  value-  The  third  type  control  card  lone 
card  per  judge  sublist]  identifies  the  judge,  desig¬ 
nates  the  alternative  conversion  type,  and  gives  the 
judge  weight  factors-  The  appendix  specifies  input 
data  format  in  greater  detail. 

(c)  Data 

The  sublir.t  ranks  and  the  self- 
evaluation  ratings  are  input  ■'  separate  sets  of  free 
format  cards.  For  the  subl  rank  set,  the  sequence 

of  alternative  numbers  indi  s  the  preference  order 

with  minus  signs  used  to  indicate  equality  or  indif¬ 
ference.  Each  sublist  ends  with  an  asterisk.  The 
sublist  self-evaluation  ratings  are  listed  on  their 
cards  in  an  order  corresponding  to  the  lexigraphic 
order  of  the  alternatives'  identification  numbers  (1, 
2,  3,  ...,  etc,). 


3.  Output  from  the  Computer  >iodel 
(a)  Aggregation  Rank  Orders 


The  primary  output  of  the  com¬ 
puter  model  for  this  research  is  the  aggregated  ran.', 
ordered  list  of  RsD  projects.  The  Snannon  majority 
method  produces  the  baseline  aggregation  rank  order 
list  for  the  model.  For  comparative  purposes,  the 
model  also  produces  the  Boraa-type  rank  orders  and 
the  Fuzzy  matrix  rank  order.  To  permit  run-by-run 
verification  and  analysis  of  each  aggregation  rank 
order,  the  model  outputs  the  inputs,  the  subiist 
matrices  (basic,  and  if  appropriate,  the  weighted 
and/or  self-evaluation  matrices >  and  the  sum  of  the 
rows  for  the  sunsaed.  Fuzzy,  and  preference  matrices. 
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(b)  Evaluation  Results 


The  model  further  provides  the 
results  of  the  evaluation  of  the  input  sublists  and 
the  aggregation  rank  orders.  It  computes,  statisti¬ 
cally  tests,  and  prints  the  major  steps  of  the  Ken¬ 
dall  coefficient  of  concordance  (7)  evaluation  of  the 
standardized  input  sublists.  The  statistical  tests 
conclude  with  statements  as  to  whether  the  input  rank 
orders  are  consistent  at  the  0.05  and  0.01  signifi¬ 
cance  levels.  Again,  for  verification  and  analysis 
of  each  evaluation,  the  model  provides  the  rank 
array,  the  alternative  suns,  means,  the  sum  of  the 
squared  deviations,  the  tied  ranking  factor,  and  the 
coefficient  of  concordance. 

The  model  also  pjrforns  up  to  six  Kendall's 
coefficient  of  concordance  analyses  of  all  two- rank 
order  combinations  of  the  four  aggregation  rank 
orders,  i.e..  Shannon  versus  Fuzzy,  Shannon  versus 
3orda,  adjusted  Borda  versus  Fuzzy,  etc.  The  output 
details  are  the  same  as  those  for  the  coefficient  of 
concordance  evaluation  for  the  input  sublists.  These 
evaluation  data  provide  a  measure  of  the  agreement 
between  the  various  final  aggregations. 


The  other  evaluation  parameters  are  Kendall's 
number  of  circular  triads,  D,  and  the  coefficient  of 
consistency,  zeta,  which  evaluate  the  cyclicity 
characteristics  of  the  Shannon  aggregation  rant 
order.  The  statistical  tests  determine  if  the  tester 
rank  order  could  have  occurred  by  chance,  ir stead  of 
by  a  somewhat  consistent  preference  method. 

The  appendix  contains  a  program  list  and  sam¬ 
ples  of  the  output  from  the  computer  model . 

C.  Subiist  Conversion  to  Standard  Format 

The  computer  model  converts  input  suolist 
rank  orders  of  alternatives  from  various  forms  into 
the  standard  format  for  the  frequency  matrices. 
Secondly,  if  the  sublist  alternatives  are  product 
requirements,  the  model  translates  those  sublists 
into  standard  form  project  rank  orders. 

1.  Conversion 

The  model  subroutine  INPUT  converts 
each  sublist  alternatives  to  standard  format.  The 
sublist  input  control  must  specify  which  conversion 
17 


sethod  is  appropriate  for  that  sublist's  rank  data. 
The  conversion  cocsand  codes  are  a_  fellows: 

a.  JCOSvU  or  JCOSV1  -  These  codes 
cean  the  sublist  input  is  in  standard  complete  fora 
and  requires  no  conversion  nor  synthetic  coapletion. 

b)  JCOKV2  -  This  code  aeans  the 
sublist  input  is  in  the  standard,  but  inco=?lete, 
fora  and  requires  no  synthetic  coapJetion. 

c}  JCONV3  -  This  code  seans  the 
sublist  inpit  is  in  the  standard,  but  incosplete, 
fora  and  requires  coapletion.  For  JC0NV3,  the  input 
rank  order  is  saved  to  the  left  for  insertion  cf  ail 
ositted  alternatives  at  a  lower,  and  equal,  rank  on 
the  right  end  of  the  list.  In  suraary,  JC0HV3  says 
the  input  list  should  be  completed  and  that  is  higher 
ranked  than  all  of  the  ositted  alternatives. 

d)  JC0HV4  -  This  code  aeans  the 
subiist  input  is  in  the  standard,  but  incosplete, 
fora  .nd  requires  cospletion.  For  3C0KV4,  the  input 
rank  order  is  aoved  to  the  right  for  insertion  of  all 
omitted  alternatives  at  a  higher,  and  equal,  rank  on 


the  left  end  of  the  list-  "n  sunaary,  3 COXY-;  says 
that  the  input  list  should  be  cocpieted,  and  that  : * 
is  lower  ranked  than  all  of  the  oaitted  alternatives. 

e)  JCOh".’5  -  This  cede  veans  the 
input  syblist  is  cardinally  scored  in  scoe  fashion 
and  that  the  alternatives  should  be  ordinal ly  ranked 
in  descending  order  of  Che  cardinal  scores,  i.e., 
best  alternative  has  highest  score. 

f)  JC0KV6  -  This  code  aeans  the 
input  sublist  is  cardinally  scored  in  sone  fashion 
and  that  the  alternatives  should  be  orcinaliy  ranked 
in  ascending  order  of  the  cardinal  scores  i.e., 
largest  valued  alternative  has  the  lowest  score - 

g)  JCOXY7  -  This  code  aeans  that 
two  insos^alete  sublists  exist  which  are  related  by  a 
single  key  alternative  in  the  prisary  list-  For 
3CCNV7,  the  secondary  list  is  inserted  and  ranked 
i=aediat;ly  below  the  key  alternative.  After  being 
coabinea,  all  lower  or  equal  rank  duplicate  alterna¬ 
tives  are  purged.  In  sussary,  JCOXV7  says  that  the 
secondary  list  is  lower  ranked  than  all  alternatives 
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in  the  primary  list  that  are  above  the  key 
altemative- 

h)  JC0KV8  -  This  code  is  the 
reverse  of  JC0NV7.  For  JCOKY8,  the  secondary  list  is 
inserted  and  ranked  immediately  above  the  key  alter¬ 
native  in  the  primary  list.  Again,  after  being  com¬ 
bined,  all  lower  or  ecual  duplicate  alternatives  are 
purged.  In  sum— ary ,  JCOHV8  says  that  the  secondary 
list  is  higher  ranked  than  all  alternatives  in  the 
prixary  list  that  are  below  the  key. 

i)  JCOKV9  -  This  code  allies  to 
combining  two-tier  inputs  into  a  single  standard 
list.  For  JCOSV9,  bcth  the  upper  tier  categories  and 
the  lower  tier  alternatives  are  ranked.  The  model 
places  the  alternatives,  in  order,  for  the  highest 
category  above  the  alternatives  for  the  second  high¬ 
est  category  above  the  alternatives  for  the  second 
highest  category,  etc. 

j)  JCOKVltf  -  This  code  again 
applies  to  combining  two-tier  inputs  into  a  single 


standard  list.  For  JCGSViO ,  the  upper  tier  cate¬ 
gories  are  unrankec,  but  the  lower  tier  alternatives 
are  ranked.  The  sodel  considers  the  categories  equal 
and  places  the  highest  alternative  frees  the  first 
category  equal  to  the  highest  alternative  s  res.  the 
second  category.  The  next  lower  rank  order  level 
would  be  the  second  place  alternative  from  one  cate¬ 
gory  equal  to  the  second  place  alternative  from 
another  category. 

k)  JC0NV11  -  For  this  two-tier 
case,  the  upper  tier  categories  are  ranked,  but  the 
lower  tier  alternatives  are  unranked.  The  model  con¬ 
siders  the  alternatives  within  each  category  to  be 
equal.  It  places  all  the  alternatives  from  the 
highest  category  first  and  equal  above  the  equal 
alternatives  from  the  second  place  category,  etc. 

l)  JCOKV12  -  For  this  two-tier 
case,  neither  the  upper  tier  nor  the  lower  tier 
alternatives  are  ranked.  The  sodel  places  all  alter¬ 
natives  as  equal  in  the  single  sublist. 


2-  Translations  -  Requirements  to 
Projects 

If  the  input  alternatives  in  the 
converted  sublists  represent  product  requi resents, 
the  model  will  translate  these  requirement  lists  into 
project  lists.  A  set  of  translation  index  equivalen¬ 
cies  must  be  separately  input  into  the  model.  An 
equivalency  statement  would  say,  for  example,  that 
Project  A  is  equivalent  to  Requirement  3,  Project  0 
is  equivalent  to  Requirement  6,  and  that  Project  A  is 
equivalent  to  Requirement  6.  It  would  be  anticipated 
that  the  translation  index  would  change  infrequently 
and  could  be  prepared  for  input  only  once  for  a 
series  of  aggregation  studies. 

D.  Matrix  and  Rank  Order  Formation 

Once  the  sublist  rank  orders  are  in  stand¬ 
ardized  project  alternative  fomats,  the  computer 
model  forms  each  into  a  sublist  frequency  matrix  that 
indicates  which  project  is  preferred  over  each  other 
project  by  pair  comparisons.  The  summed  frequency 
matrix  is  the  matrix  element  addition  of  the  sublist 
frequency  matrices. 


The  preference  matrix  is  formed  from  the 
paired  comparisons  of  each  of  the  summed  frequency 
matrix  element  values. 

The  project  scores  are  computed  from  the  row, 
and  column,  if  appropriate,  suns  of  the  elements  of 
the  summed  frequency  matrix  and  the  preference 
matrix.  The  model  then  places  that  project  with  the 
highest  score  highest  in  the  rank  order  and  repeats 
the  search  for  each  equal  or  lower  scored  project. 

E.  Ancillary  Processes 
1.  Weighting 

(a)  Decision-Maker  Methods 

The  model  input  weighting  func¬ 
tions  are  input  as  a  control  code  and  weighting 
factor  data  codes.  The  weighting  factors  are  the 
weights  applied  to  each  alternative,  WHI,  and  the 
weights  applied  to  each  judge,  KHJ.  If  Alternative  a 
has  a  WHI  value  other  than  1,  every  time  Alternative 
a  appears  in  a  sublist  frequency  matrix,  it  will  be 
weighted  by  the  factor  WHI.  If  Judge  2  has  a  WHJ 
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value  other  than  1,  every  other  alternative  in  Judge 
2*s  sublist  will  be  weighted  by  the  factor  WHJ.  If 
Alternative  a  is  in  Judge  2's  subiist,  *t  will  be 
dual-weighted  by  WHI  and  WHJ. 

The  weighting  control  code,  NWT,  is  input  as  a 
control  integer  number,  zero  to  eight.  The  weight 
control  codes  have  the  following  meaning: 

1)  NWT  =  0  -  Apply  no  weights. 

2)  NWT  =  1  -  The  alternative 
weight,  WHI,  is  multiplied  by  the  alternative  score 
times  four  in  the  sublist  frequency  matrix. 

3)  NWT  =  2  -  The  judge  weight, 
WHJ,  and  the  alternative  weight,  WHJ,  are  multiplied 
by  the  alternative  score  times  four  in  the  sublist 
frequency  matrix. 

4)  NWT  =  3  -  The  alternative 
score  times  four,  in  the  sublist  frequency  matrix  is 
taken  to  the  WHI  exponent. 


5)  NWT  =  4  -  The  alternative 
score  times  four,  in  the  sublist  frequency  matrix  is 
taken  to  the  WHI  times  WHJ  exponent. 

6)  NWT  =  5  -  The  alternative 
score  times  four,  in  the  sublist  frequency  matrix  is 
multip. ied  by  the  alternative  weight,  WHI,  and  is 
taken  to  tlie  WHJ  exponent. 

7)  NWT  =  6  -  The  alternative 
score  times  four,  in  the  sublist  frequency  matrix  is 
multiplied  by  the  judge  weight,  WHJ,  and  is  taken  to 
the  WHI  exponent. 

8i  NWT  =  7  -  The  alternative 
weight,  WHJ,  and  the  judge  weight,  WHJ,  are  added  to 
the  alternative  score  times  four,  in  the  sublist  fre¬ 
quency  matrix. 

9)  NWT  =  8  -  The  weighted 
score  is  the  natural  logarithm  of  the  product  of  the 
alternative  times  four,  in  the  sublist  frequency 
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matrix,  the  alternative  weight,  WHI,  and  th ;  judge 
weight,  WHJ. 

(b)  Judge  Self-Evaluation  Methods 

The  judge  self-evalu  tion  (JSE) 
methodology  is  implemented  as  a  weighting  scheme. 

JSE  is  controlled  by  the  MATR  code  in  the  control 
card,  is  follows: 

1)  MATR  =  0  -  No  JSE- 

2)  MATR  =  1  -  Th-  JSS  factors 
are  .pplied  to  all  ranked  alternatives.  No  threshold 
is  applied. 

3)  MATR  =  2  -  Tie  JSE  factors 
are  applied  to  all  ranxed  alternative:.  A  threshold 
is  applied  that  purges  all  ranked  alternatives  with 
JS£  ratings  belcw  the  threshold  value  which  is  input 
as  a  THLD  value. 

The  JSE  ratines,  ^plied  as  a  :y  real  number, 
ire  input  for  each  judge's  alternatives  by  the  set  of 
S umber  3  data  cards  vhich  are  free  o  treat.  The  IS  EM 


value,  input  with  the  judge’s  identification  data,  is 
the  saiisn;  value  that  that  ledge  conic  assies  for 
his  JSE  rating  scale.  Throogh  the  ISEH  ralo=s,  each 
judge's  Jfs  ratings  are  scaled  onto  a  rests  to 
scale,  “he  scaled  JSE  ratines  are  neltiplied  ly  the 
alternative  scores  in  each  sub I ist  fregeeocy  matrix, 
as  were  the  rclt lpl icative  weights-  The  judge's 
self-exal  uat  icn  seal  ists  are  sssssed  into  the  sensed 
frequency  matrix  and  the  aggregation  continoes  as  :f 
the  sstlist  were  cecisices-naker  weighted. 

The  application  of  JSE  ratings  prohibit* 
dependable  synthetic  couplet ion  of  sab! ists  teem- - 
any  cuncem^nle  synthetic  JSE  rating  caepiet  — 
oethed  wsei d  probably  resol t  in  values  that 
inconsistent  with  those  applied  by  the  jrodge'a 
inputs. 

2.  Preference  Scoring  Const a- ; - 

The  preference  scoring  c'  nan  f  t.s  to 
be  used  10,  0.5,  1J  or  |-i,  ©,  fregoency 

iid  preference  matrices  are  desig-  ter  s»  the  raloes 
of  the  control  card  inputs  f or  ’Zr'TT? .  tmr  UCTJu. 
SPTfPl,  for  the  frequency  matrix  constants. 
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can  have  control  values  of  zero  or  one.  NPTYP2,  for 
the  preference  matrix  constants,  can  also  be  zero  or 
one.  These  values  for  NPTYP1  or  NPTYP2  mean 

0  :  [0,  0.5,  1] 

1  :  l-l,  0,  11 

The  model  applies  the  NPTYP1  and  NPTYP2  values  in  the 
frequency  and  preference  matrix  subroutines. 

3.  Fuzzy  Set  Rank  Order 

No  controls  are  necessary  to  obtain  a 
Fuzzy  rank  order  and  its  evaluation.  But  if  the 
standard  project  sublists  are  incomplete,  or  if  JSE 
and/or  weighting  are  used,  the  Fuzzy  computations  are 
bypassed.  The  Fuzzy  matrix  is  applicable  for  this 
research  purpose  only  if  the  cell  values  for  each  x,y 
plus  tne  cell  values  for  eac.i  y,x  are  equal  to  one. 
The  Fuzzy  set  matrix,  rank  older,  and  evaluation 
computations  were  described  in  Dobbins  (4). 


4.  F.valuation  Techniques 

No  controls  are  necessary  to  obtain 
evaluation  of  the  input  rank  orders.  In  each  run 
where  the  standard  project  sublists  ate  complete,  the 
Kendall's  coefficient  of  concordance  computation  and 
tests  are  made.  For  every  run  the  Kendall's  number 
of  circular  triads  and  the  coefficient  of  consistency 
are  calculated  and  tested  for  the  Shannon  aggregation 
rank  order.  The  final  aggregation  rank  orders  are 
comparatively  evaluated  by  the  coefficient  of  con¬ 
cordance  method  for  each  combination  of  final  rank 
orders  that  is  calculated  by  the  model.  The  evalua¬ 
tion  and  test  calculation  techniques  are  summarized 
in  the  remaining  paragraphs  of  this  chapter. 

The  evaluation  methods  selected  had  to  accom¬ 
modate  the  several  (n  >_  3)  rank  orders  being  aggre¬ 
gated,  and  the  several  aggregated  rank  order  outputs 
from  the  different  methods.  Three  Kendall  methods 
were  chosen  for  the  evaluations: 
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a)  Kendall's  coefficient  of 
concordance  test 

b)  Kendall's  circular  triads 
analysis 

c)  Kendall's  rank  order  consistency 
analysis  and  test. 

The  implementation  of  each  into  the  model  will  be 
discussed  in  the  next  sections. 

(a)  Coefficient  of  Concordance  Test 

1)  The  Coefficient  -  Kendall's 
coefficient  of  concordance,  W,  was  chosen  as  a  mea¬ 
sure  of  the  relation  among  several  rankings  {n  >  3) 
of  alternatives.  Arrow  (1)  says  Kendall's  statistic 
W  may  be  used  in  the  same  situation  in  which  Fried¬ 
man's  two  way  analysis  of  variance  by  ranks  test  sta¬ 
tistic  is  available.  Conover  (3)  said  further  that 
Kendall’s  W  was  probably  intended  as  a  measure  of 
agreement  in  rankings  rather  than  as  a  test  statis¬ 
tic.  This  interpretation  of  Kendall's  W  coincides 
with  the  needs  of  this  research  model.  The- coeffi¬ 


cient  of  concordance  is  applied  in  two  ways.  First, 
the  method  measures  the  agreement  among  the  judges' 
sublists.  Second,  the  method  measures  the  agreement 
between  combinations  of  aggregated  rank  orders 
obtained  with  different  majority  rule  methods,  i.e., 
Borda,  Adjusted  Borda,  Fuzzy  Set,  and  Shannon.  The 
first  application  provides  an  indication  of  the 
agreement  and  divergence  of  the  judges,  while  the 
second  application  provides  a  measure  of  the  agree¬ 
ment  between  the  final  rank  orders  results,  not  just 
the  winning  alternative,  from  different  majority  rule 
methods.  The  Kendall's  W  method  is  limited  to  sets 
of  rank  orders  that  have  the  same  length,  'therefore, 
if  partial  and  complete  rank  orders  are  aggregated 
together,  a  Kendall's  W  measurement  cannot  be  calcu¬ 
lated  unless  the  incomplete  rank  orders  are  syntheti¬ 
cally  completed. 

The  rationale  of  the  coefficient  of  concord¬ 
ance,  W,  is  to  serve  as  an  index  of  the  divergence  of 
the  actual  agreement  shown  in  the  data  from  the  most 
perfect  agreement,  Seigel  (8). 

To  compute  W,  first  array  the  rank  orders  in  a 
table  with  M  judges  ranks  listed  in  rows  and 
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alternatives  in  columns.  Hext,  find  the  sum  of  the 
ranks  Rj,  in  each  alternative  column.  The  mean  sum 
Rj,  is  calculated  by  summing  Rj  values  for  all 
alternatives  and  then  dividing  by  the  number  N,  of 
different  alternatives.  Next,  the  deviation  from  the 
mean  |Rj  -  Rjl  is  calculated  for  each  alterna¬ 
tive.  Next  the  square  of  these  Rj  deviations  are 
summed  into  an  S  value.  S,  therefore,  is  stated  as 


1  t  ?  (t3  -  t) 
12 


where  ^t,g  means  to  sum  the  (t^  -  t)  term  for 
each  tied  group  in  the  judge's  sublist.  Third,  the 
Tj  values  are  summed  into  a  total  f*r  all  rank 
orders  in  the  problem  by 


M 

Z  T 
i=l 


Tied  alternatives  in  a  ranking  cause  complica¬ 
tions  in  Kendall's  W  computations.  Excess  numbers  of 
tied  ranks  in  an  aggregation  tend  to  depress  the 
value  of  W.  A  correction  is  available,  Kendall  (7) , 
to  adjust  this  effect  of  excessive  tied  rankings. 

To  correct  for  tied  ranks,  first  count  the 
number  of  observations,  t,  in  a  group,  g,  of  alterna¬ 
tives  tied  for  a  given  rank  level  in  each  judge's 
sublist.  Second,  the  T  factor  is  calculated  for  each 
row,  i,  (judge's  sublist)  by  the  equation 


The  tied  ranking  correction  and  the  squared 
sum  of  deviations,  S,  are  used  in  the  coefficient  of 
concordance,  W,  equation 

(SP"  (n3  -  N;  -  M  ?  T 

i=l 

where  M  is  the  number  of  judges  and  N  is  the  number 
of  alternatives.  If  there  are  no  significant  tied 
ranks,  K  is 
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(A)  »2  '»3  - «  ■ 

2)  The  Test  -  Kendall  (7) 
developed  methods  and  special  small  N  value  prob¬ 
ability  tables  to  test  the  hypothesis  H0;  there  is 
perfect  disagreement  between  the  judges  (there  is  no 
concordance  between  judges).  The  test  for  H0 
varies  depending  on  the  value  of  N  (the  number  of 
alternatives).  W  varies  from  zero  to  one.  It  will 
be  one  when  the  ranks  assigned  by  each  judge  are 
exactly  the  same  as  those  by  the  other  judges.  W 
will  be  zero  when  there  is  maximum  disagreement  among 
the  judges. 

For  N  (number  of  alternatives)  between  three 
and  seven  inclusive,  and  M  (judges)  <  20,  the  signi¬ 
ficance  of  concordance  under  Hq  is  tested  by  the  S, 
the  sum  of  the  squared  deviations,  test  in  the  model 
by  using  Table  1,  which  is  a  combination  and  exten¬ 
sion  of  two  Kendall  tables  (7),  (Appendix  Tables  5 
and  6) . 


If  the  aggregation  model  calculated  values  for 
S  exceeds  the  tabulated  critical  values  for  each 
level  of  significance  (0.01  and  0.05),  then  it  is 
concluded  that  agreement  is  significant. 

For  the  degree  of  freedom,  v,  less  than  or 
equal  to  30,  which  includes  N  (number  of  alterna¬ 
tives)  greater  than  seven  and  less  than  31  and  M 
(number  of  judges)  greater  than  two,  the  significance 

under  H&  is  tested  by  the  corrected  W,  the  coeffic- 

2 

ient  of  concordance,  and  the  Xcai  (calculated  chi- 
square)  where 

xcal  “  M(N  -  1}  W 

with  the  degrees  of  freedom,  v  -•  N  -  1.  The  Xcal 
value  is  tested  against  xcr  (critical  x2),  in  (7) 

(Appendix  Table  8),  on  page  191  in  Kendall  (7).  The 

•  .  2  * 

0.01  and  0.05  significance  levels  of  xqr  are  read 

from  the  P  =  0.01  and  P  *  0.05  columns,  respectively. 

2  2 
If  Xcal  is  greater  than  xcr»  then  Hq  can  be 

rejected,  and  it  can  be  concluded  that  there  is 
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TABLE  1.  SIGNIFICANT  POINTS  OF  S  (FOR  TEE  COEFFICIENT  OF  CONCORDANCE  W) 


Values  at  0.05  Level  of  Significance 


7.8  18.5  37 

18  35  64.4 

25  49.5  88.4 

31  62.6  112.3 

38  75.7 

48.1  ’ 


18.5 

37 

58 

97 

35 

64.4 

103.9 

157.3 

49.5 

88.4 

143.3 

217.0 

62.6 

112.3 

182.4 

276.2 

75.7 

136.1 

221.4 

335.2 

101.7 

183.7 

299.0 

453.1 

114.8 

207.4 

337.8 

512. 

127.8 

231.2 

376.7 

571.0 

153.8 

278.6 

454.2 

688.6 

179.9 

326.1 

531.7 

806.1 

192.9 

349.8 

570.5 

864.9 

205.9 

373.5 

609.3 

923.7 

232. 

421. 

686.8 

1041.2 

258.0 

468.5 

764.4 

1158.7 

Values  at  0.01  Level  of  Significance 


7.9 

19 

39 

68 

104 

19 

42 

75.6 

122.8 

185.6 

31 

61.4 

109.3 

176.2 

265.0 

41 

80.5 

142.8 

229.4 

343.8 

52 

99.5 

176.1 

282.4 

422.6 

66.8 

137.4 

242.7 

388.3 

579.9 

75.9 

156.4 

275.9 

441.2 

658.4 

85.1 

175.3 

309.1 

494.0 

737.0 

103.5 

213.1 

375.5 

599.7 

894. 

121.9 

250.9 

441.9 

705.4 

1051. 

131.0 

769.8 

475.2 

758  . 

1129.5 

140.2 

288.7 

508.4 

863.8 

1208. 

158.6 

326.4 

574.8 

916.6 

1364.9 

177.0 

364.2 

641.2 

1022.2 

1521.9 

Note:  Modified  Kendall  s  Appendix  Table  6  (7) 


significant  agreemeht  among  the  judges  at  the  levels 
selected  (0.01  and  0.05). 


For  N  between  three  and  seven  inclusive,  and  M 

2 

greater  than  20,  the  model  used  the  same  xcal  and 
Xcr  method  just  described. 


For  degree  of  freedom,  v,  greater  than  30 
(N  >  31)  and  all  values  of  M  greater  than  two,  the 
significance  under  H0  is  tested  by  the  tie  correc¬ 
ted  W,  the  coefficient  of  concordance,  x^l  shown 
previously,  and  the  Zcal  value  tested  against  the  Z 
in  the  normal  distribution.  First  calculate 


CAL 


=f^~ 


CAL 


</  2v  -  1 


with  the  degrees  of  freedom,  v  =  n  -  1.  The  ZCAL 
value  is  tested  against  Appendix  Table  A,  page  247, 
in  Seigel  (8).  Pqr  values  are  0.01  and  0.05  for 
the  respective  significance  values.  If  Pcaj,  is 
less  than  or  equal  to  PCR,  then  H0  can  be  rejec¬ 
tee!,  and  it  may  be  concluded  that  there  is  signifi¬ 
cant  agreement  among  the  judges  at  the  levels  selec¬ 


ted  (0.01  and  0.05).  The  model  for  this  aggregation 
research  selects  the  type  of  cor.cordai  ce  statistical 
test  based  upon  the  values  of  M  and  N. 


(b)  Circular  Triads  Analysis 

Kendall's  circular  triads  anal¬ 
ysis  (7,21)  was  chosen  as  a  measure  of  the  acyclicity 
of  the  pair  majorities  in  the  preference  matrix  of 
the  Shannon  method.  In  preference  matrices  of  more 
than  three  alternatives,  it  is  possible  to  have  the 
majority  preferences  of  three  alternatives  aligned  to 
be  ui  :ular  triads.  For  example,  Kendall  presents  a 
preference  matrix  example  ((21)  page  145)  which  would 
have  a  Shannon  majority  rule  aggregate  rank  order  of 
A=C>B=E=F>D.  When  analyzed  internally,  it 
has  five  circular  trials:  ACDA,  ABDA,  AEDA,  AFDA, 
and  BEFB.  Triads  are  counted  because,  for  example, 
any  circular  tetrads  must  contain  two  circular 
triads.  Kendall  further  proved  that  the  maximum  pos¬ 
sible  number  of  circular  triads  is 


if  N  (number  of  alternatives)  is  odd. 
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and  it  is 


(N3  -  4N) 

- 23 - 


if  N  is  even. 


The  minimum  number  of  triads  is  zero.  He  further 
proved  that  the  maximum  and  minimum  number  of  triads 
can  be  attained  by  arrangement  of  preferences. 
Kendall's  equation  for  d,  the  number  of  circular 
triads  in  a  preference  matrix,  consists  of  the  terms 
N  (number  of  alternatives)  and  a^,  the  sum  of  the 
rows  of  the  preference  matrix.  The  equation  for  d  is 

1  1  N 
d  =  ~  N  (N  -  1)  (N  -  2)  -  i  .Z.  a.  (a.  -  1). 

D  i=JL  X  i 


which  is  the  sum  of  aj  for  integer  valued,  no  tied 
pairs,  preference  matrices.  To  resolve  this  problem, 
the  model  for  this  research  brackets  the  possible  d 
values  if  fractional  pairs  of  a^’s  exist.  The 
steps  of  the  d  bracketing  method  are: 

Step  1:  Arrange  the  a^  row  totals  in  order 
of  their  value. 

Step  2:  Count  the  number  of  fractional  aj 
row  totals. 

Step  3:  Round  the  upper  one-half  of  each  pair  1 
of  the  fractional  aj  values  upward  to  their  next 
larger  integer  values. 


The  Kendall  derivation  of  d  is  based  on  rank 
orders  without  tied  pairs  (indifference).  When  a 
preference  matrix  has  tied  pairs,  it  causes  pairs  of 
a^  terms  that  have  fractions.  The  fractions  are 
always  one-half,  i.e.,  1.5,  3.5,  6.5,  7.5.  When  tied 
pairs  exist,  the  sum  of  the  aj  is  not  necessarily 

N \  _  f  N  _  N!  _  N  (N  -  1) 

2  )  ~  \2,  K  -  2/  ~  21  (N  -  2)  !  2 


Step  4:  Round  the  lcwer  one-half  of  each  pair 
of  fractional  aj  values  downward  to  their  next 
smaller  integer. 

Step  5:  Verify  that  the  sum  of  the  rounded 
aj's  equals  1/2  N  (N  -  1). 

Step  6:  Calculate  a  d  value  for  this  rounded 
set  of  a^  values.  Label  this  the  "lower  d"  since 


E-^l 

# 


Iras 


it  will  give  the  lower  value  of  zeta,  the  coefficient 
of  consistency  yet  to  be  described. 

Step  7:  Return  to  the  ordered  unrounded 
aj's  and  round  the  upper  one-half  of  eacn  pair  of 
the  fractional  aj  values  downward  to  their  next 
smaller  in'.-'ger  values. 

Step  8:  Round  the  lower  one-half  of  each  pair 
of  the  fractional  a*  values  upward  to  their  next 
larger  integer  values. 

Step  9:  Verify  that  the  sum  of  the  second 
rounded  aj’s  equals  1/2  N  (N  -  1). 

Step  10:  Calculate  d  value  for  this  second 
rounded  set  of  aj  values  and  label  this  the  "upper 
d". 


Step  11:  Average  the  lower  d  and  upper  d  to 
form  an  approximate  d  for  the  matrix  with  the  tied 
pairs. 


(c)  Coefficient  of  Consistency 


Kendall  (7)  extended  the  number  of  circu¬ 
lar  triad  analyses  to  a  coefficient  of  consistency, 
zeta,  which  relates  the  calculated  number  of  circular 
triads,  d,  to  the  maximum  number  possible:  1/24 
(N3  -  N)  if  N  odd  or  1/24  (N3  -  4N)  if  N  is  even. 

The  equation  for  the  coefficient  of  consistency  is 


zeta  = 


24d 


if  N  is  odd 


24d 


N3  - 


4N 


if  N  is  even. 


For  no  inconsistencies  (no  circular  triads),  zeta  is 
unity.  As  the  number  of  circular  triads  increases, 
zeta  approaches  zero. 


To  test  Kendall's  coefficient  of  consistency, 
special  tables  modified  from  Svestka  (9)  and  Kendall 
(7),  x2  tables,  and  normal  distribution  Z  tables 
will  be  used.  The  hypothesis  tested  is  Hq,  zeta  is 
not  significant  and  there  is  no  consistency  in  the 
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aggregated  rank  order-  The  test  for  H0  again 
varies  depending  on  the  value  of  N  (the  number  of 
alternatives).  Begin  with  a  calculated  zeta. 


For  N  (number  of  alternatives)  less  than  or 
equal  to  nine,  use  Table  2  which  is  codified  froa 
Appendix  Table  A-3  in  Kendall  (7)  and  Svestka  (9). 

For  an  N  value,  enter  the  table  with  a  zeta  to  obtain 
a  Pcal  value.  If  the  Pcal  equals  or  exceeds  each 
level  of  significance  (0-01  and  0.05),  then  Hq  is 
accepted  and  the  rank  order  is  not  consistent.  If 
each  level  of  significance  is  greater  than  ?CAL» 

Ho  is  rejected  and  it  is  concluded  the  rank  order 
is  significantly  consistent. 

For  N  (number  of  alternatives)  10  and  £  23, 
the  significance  under  H0  is  tested  by  a  Xcal 
(calculated  chi-sqcare)  test,  where 


+  V 


The  Xchh  value  is  tested  against  Xq-%  in  Appendix 

Table  8,  page  191,  in  Kendall  (7).  The  0.05  and  0.01 

2 

significance  levels  of  Xq%  are  read  froa  the  P  = 

0.95  and  P  =  0.99  columns,  respectively.  If  xcs  is 

>  Xf-ar ,  then  accept  that  the  rank  order  is  not 
~  2  2 
consistent,  but  if  *cf.  is  <  xcal*  th€n  reject 

Hq  and  it  can  be  concluded  that  there  is  signifi¬ 
cant  consistency  among  the  final  rank  order. 

For  degrees  of  freedom,  v,  greater  than  30 
(JJ>235»  the  significance  under  H0  is  tested  using 
the  Xcal,  Shown  above,  and  the  2 cal  value  tested 
against  the  2  in  the  noraal  distribution.  First 
calculate 


where  the  degrees  of  freedom,  «,  are 


0 


1.000 


0.550 


0.050 

0.949 

0.100 

0.859 

0.150 

0.768 

0.200 

0.629 

0.250 

0.520 

0.300 

0.390 

0.350 

0.299 

0.400 

0.208 

0.450 

0.153 

0.500 

0.094 

0.600 

0.037 

0.650 

0.023 

0.700 

0.011 

0.750 

0.0064 

0.800 

0.0028 

0.850 

0.0013 

0.900 

0.0004 

0.950 

0.0001 

1.000 

0.0000 

j  -  *2v  -  1  inti  the  3esr«e  ef  fr«sat. 
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fro*  the  table  for  the  -cal  values-  The 

valoes  are  0-C1  and  C-03  for  the  chosen  significance  i 

I 

levels-  If  ?cal  <  ?ca»  then  accept  H0  and 
esaclssde  that  there  is  no  significant  consistency. 

If  **CJU.  >  ?CS  then  reject  Hq  and  conclude  that 
there  is  significant  consistency-  The  roodel  selects 
the  correct  test  based  icon  the  values  of  N.  j 


is  tested  against  Table  V 

igei  (S).  ?cAI.  valoes  are  feed 


I’l.  COMPUTER  MODEL  VERIFICATION  AND  VALIDATION 

This  chapter  contains  the  verification  and 
validation  of  the  computer  model,  including  sample 
numerical  validation  problems. 

A.  Verification 

1.  Model  Design  and  Test 

Verification  that  the  rank  order 
aggregation  computer  model  was  implemented  properly 
in  the  computer  code  was  accomplished  through  the 
modular  design  of  the  code,  unit  testing  of  each  sub¬ 
routine,  phased  buildup  of  the  computer  model  with 
tests  after  each  phase  is  added,  running  a  series  of 
test  problems  for  comparisons  of  computer  model  out¬ 
put  with  hand  calculated  results,  and  a  final  exer¬ 
cise  of  all  options  in  the  program. 

Extensive  model  validation  in  the  sense  of 
running  large  aggregation  rank  ordered  priorities 
problems  was  not  possible  due  to  the  lack  of  avail¬ 


able  problems  with  known  solutions  using  any  of  the 
four  majority  rank  methods  that  are  built  into  the 
computer  model.  Validation  of  portions  of  the  model 
options  against  moderate  sized  known  problems  with 
solutions  from  the  literature  was  accomp] ished. 

Some  of  the  special  features  of  this  model,  such 
as  weighting,  fuzzy  rank  orders,  and  ]uage  self- 
evaluation  were  validated  by  calculated  extensions 
from  matrix  aggregation  methods  confirmed  against 
the  literature. 

2.  Verification  Demonstration 

The  computer  model's  flexibility  was 
verified  and  demonstrated  through  the  exercise  of 
most  of  the  computation  options  for  a  single  set  of 
complete  sublist  rank  orders,  a  single  set  of  partial 
sublist  rank  orders,  a  set  of  alternative  and  judge 
weights,  and  a  set  of  self-evaluation  ratings.  The 
data  input  reflected  five  judges'  (oie  through  five) 
evaluation  of  seven  alternatives  (A  through  G).  The 
judges'  rank  order  sublists  for  the  complete  set  of 
data  areas  follows: 
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Jucge  Is 

Alternative  Order: 

A>B>C>D>E>F>G 
Alternative  Inde>^  Order: 
1>2>3>4>5>6>7 

Judge  2: 

Alternative  Order: 

G>B=D>A  =  C>F>E 
Alternative  Index  Order: 
7>2=4>1=3>6>5 

Judge  3: 

Alternative  Order: 

C>D=E>F=G>A>B 
Alternative  Index  Order: 
3>4=5>6=7>1>  2 

Judge  4: 

Alternative  Order: 

A>G>B=F>C=D>E 
Alternative  Index  Orders 
1>7>2=6>3=4>5 


Judge  5: 

Alternative  Order: 

D>C>B>A=E>G>F 
Alternative  Index  Order: 
4>3>2>I  =  5>7>6 

The  decision-maker  weights  are  as  follows: 

Judge  Weights: 

Judge  1:  1 

Judge  2:  1 

Judge  3:  4 

Judge  4:  2 

Judge  5:  1 

Alternative  Weights: 

Alternative  A  (1):  2 

Alternative  B  (2):  2 

Alternative  C  (3):  4 

Alternative  D  (4):  1 

Alternative  E  (5):  1 

Alternative  F  (6):  4 

Alternative  G  (7):  1 
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The  judges'  self-evaluation  ratings  for  these  altern¬ 
atives  are  listed  below.  Since  the  JSE  scales  differ 
for  each  judge,  the  upper  limit  of  each  scale,  where 
the  rating  is  units,  is  also  given  as  the  ISEM  value: 


Judge 


Alternative 

1 

2 

3 

4 

5 

A 

2 

1 

4 

6 

5 

B 

8 

4 

2 

10 

4 

C 

4 

o 

4 

10 

5 

D 

6 

3 

3 

6 

5 

E 

2 

1 

4 

8 

1 

F 

10 

5 

4 

7 

S 

G 

8 

4 

3 

5 

4 

Limit 

(ISEM) 

10 

5 

4 

10 

5 

The  judges 

■A 

'  rank  order 

sublists 

for  the 

incora- 

plete  set  of  data 

are 

listed 

below.  The  judges 

'  sub- 

lists  for  Judges  1,  4,  and  5  were  complete  and  were 
the  same  values  as  for  the  complete  set  of  data.  The 
incomplete  sublists  are: 


Judge  2: 

Alternative  Order: 

G>B=D>A>F>E 

Alternative  Index  Order: 

7>2=4>1>6>5 

Judge  3: 

Alternative  Order: 

E  >  F  =  G 

Alternative  Index  Order: 

5  >  6  =  7 

All  weights  are  the  same  for  the  alternatives  for  the 
complete  and  incomplete  sublists  data.. 

The  model  options  exercised  for  the  complete 
sublist  demonstration  problem  are  the  eight  decision¬ 
maker  weight  types  (NWT  1  tfirough  8),  the  two  judge 
self-evaluation  types  JSE  M  =  1  (without  threshold) 
and  JSE  M  =  2  (with  threshold),  the  matrix  scoring 
constants  (0  for  0,  1/2,  1  and  1  for  -1,  0,  1),  and 
combinations  thereof.  The  model  outputs  compared 
consisted  of  the  adjusted  Borda  rank  order,  the 
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Preference  rank  order,  coefficient  of  consistency 
data,  and  coefficient  of  concordance  data  for  the 
adjusted  Borda  rank  order  compared  to  the  Preference 
rank  order.  The  consistency  data  included  the  number 
of  circular  triads  (d),  the  consistency  coefficient 
(zeta),  yes-no  (Y,  N)  statements  as  to  whether  the 
consistency  coefficient  was  significant  at  the  5  per¬ 
cent  and  1  percent  levels.  The  results  concordance 
data  are  the  mean  (M),  the  square  of  the  deviations 
(S),  the  Kendall's  concorance  values  (W),  and  yes-no 
(Y,  N)  statements  as  to  whether  the  adjusted  Borda 
and  the  Preference  aggregation  orders  are  in  signifi¬ 
cant  concordance  to  the  5  percent  and  1  percent 
levels.  Since  most  runs  were  weighted  or  self- 
evaluated,  Fuzzy  comparative  rank  order  data  were 
unavailable.  Table  3  presents  the  results  for  the 
complete  sublists.  The  first  line  of  each  table  uses 
>  and  =  symbols.  After  the  first  line,  commas  repre¬ 
sent  the  greater  than  (>)  symbols.  For  this  example, 
the  resulting  rank  orders  vary  widely  for  each  model 
parameter  option  except  the  changes  in  scoring  con¬ 
stants.  For  qualitative  verification,  each  run 
should  be  compared  with  the  basic  run  (Cl).  For 
example.  Run  C2  uses  multiplicative  alternative 
weighting  {WI).  For  this  example,  alternatives  C  (3) 


and  F  (6)  are  weighted  heaviest,  followed  by  alter¬ 
natives  A  (1)  and  B  (2),  followed  by  the  remaining 
alternatives.  This  explains  how  the  3  and  6  alter¬ 
natives  move  to  higher  rank  positions  in  Run  C2  as 
compared  to  Run  Cl.  Similar  logic  can  explain  the 
differences  in  each  run  from  Cl.  The  consistency 
data  show  that  the  multiplicative  and  exponential 
weight  types  tend  to  bring  the  Borda  count  matrix 
aggregation  closer  in  consistency  to  the  majority 
preference  matrix  aggregation  order.  The  model 
options  exercised  for  the  partial  sublists  demon¬ 
stration  problem  are  the  same  as  those  for  the  com¬ 
plete  sublists  data  plus  the  two  sublist  completion 
options,  JCONV  3  and  JCONV  4.  The  model  output  types 
for  the  partial  ’ata  are  the  same  as  for  the  complete 
data.  Table  3  presents  these  results  for  the  partial 
sublists.  Run-by-run  comparative  analysis  shows  that 
the  options  are  reasonable. 

B.  Model  Validation 

Computer  model  validation  was  accom¬ 
plished  by  comparing  results  of  the  computer  model  to 
results  for  examples  found  in  the  literature.  The 
literature  often  gave  only  winners  for  the  method 


employed.  The  validation  was  divided  into  areas  ->f 
method  emphasis  in  the  literature  examples  as  fol¬ 
lows:  Borda  and  adjusted  Borda;  Borda,  Condorcet, 
and  Black;  Borda,  Condorcet,  Black  and  Copeland; 
Copleland;  Shannon  preference  and  others;  and  special 
purpose  examples  to  validate  other  model  areas  such 
as  tied  data  and  evaluation  tests.  Each  case  in 
Tables  4  through  9  presents  the  literature  example, 
its  published  results,  the  comparable  results  from 
the  computer  model,  and  additional  model  results. 

All  six  tables  have  the  same  format.  The 
left  half  of  each  table  page  is  quoted  from  the 
literature.  First  the  reference  identification  is 
listed,  then  the  example  rublist  rank  orders  are 
shown.  Last,  key  answers  fnm  the  literature  are 
given.  The  right  half  of  each  table  page  contains 
results  from  aggregating  the  literature  example  sub¬ 
lists  in  the  computer  model.  The  upper  left  portion 
of  the  computer  model  side  of  the  page  contains  the 
various  final  rank  orders  as  computed.  The  upper 
right  portion  of  the  model  side  of  the  page  contains 
the  results  of  the  coefficient  of  consistency  test¬ 
ing  of  the  preference  matrix.  The  lower  portion  of 
the  model  side  of  the  page  contains  coefficient  of 


concordance  results  for  the  sublists  and  for  selecte . 
pairs  of  final  aggregation  results. 

Fcr  Case  1  of  Table  4,  Richelson  presented  X 
as  the  Borda  winner  which  is  in  agreement  with  both 
computed  Borda  orders.  "Majority"  in  Case  6  means 
the  alternative  which  has  the  most  "majority"  victor¬ 
ies.  In  the  model,  "majority"  would  correspond  to 
the  PREF  order  or  the  Copeland  order  if  different 
matrix  scoring  constants  are  considered.  Again,  in 
Cases  3,  4,  and  6,  the  computer  results  correspond  to 
the  literature  example.  In  Cases  2,  5,  and  7  througr. 
11,  the  literature  examples  give  the  Borda  and  in 
some  cases,  the  adjusted  Borda  counts.  For  Cases  2, 
5,  7,  and  11,  where  there  are  no  ties  in  the  sublist 
ranks,  the  computer  data  fully  agrees  with  the  liter¬ 
ature  examples.  But  in  Cases  8>  9,  and  10,  where 
there  are  ties  (indifference)  in  the  sublist  ranks, 
the  computed  adjusted  Borda  rank  order  counts  agree 
with  the  literature,  but  the  Borda  counts  do  not 
match.  Black  (BK-B1)  said  that  the  purpose  of  the 
alternate  Borda  count  method  was  to  correct  problems 
in  the  Borda  count  method  when  ties  exist.  Black's 
Borda  method  assigns  to  a  tied  alternative  the  score 
of  the  average  tied  position  while  the  Borda  count 


47 


TABLE  4.  (CONTINUED) 


TABLE  4.  (CONTINUED) 


Case  II  Ref:  Black  (2)  p.  158 
Qty  Sublist  Orders 

1  A  >  B  >  C 

6  C  >  B  >  A 

7  A  >  C  >  B 

7  B  >  C  >  A 


Answers:  Borda  Count: 

A  -  16,  B  -  21,  C  -  26 


Aggregation  Orders  Consistency 


Borda  Count:  A  "  16,  D  “  0 

B  -  21, 

C  -  26 

Borda  ■  Adj  Borda:  C  >  B  >  A  zeta  » 

Pref:  C  >  B  >  A  5Z  Cons: 

1Z  Cons: 

l 

Yes 

Yes 

Concordance 

*Sublists 

Borda/Pref 

Mean: 

8 

4 

Sum  Sq: 

0 

8 

Coeff  W: 

0 

1.0 

5Z  Cone: 

No 

Yes 

1Z  Cone: 

No 

Yes 

55 


Mean: 
Sum  Sq: 
Coeff  V 
5Z  Cone 


IX  Cone 


Mo 


60 


4l3( 


Bord»  ,  Condorcet,  and  Black 


TABLE  5.  (CONTINUED) 


Case  8  Ref:  Black  (15)  p.  14 
Oty  Sublist  Orders 

3  B  >  A  >  C 

3  C  >  A  >  B 

4  A  >  B  >  C 

Answers:  Adj  Borda  Count: 

A  «  8,  B  -  0,  C  -  -8 

Condorcet:  A 


Aggregation  Orders 


Consistency 


Adj  Borda  Count: 

A  *  8,  B  -  0,  C  -  -8 

D  -  0 

Borda  *  Adj  Borda 

A  >  B  >  C 

zeta  »  1 

Pref: 

A  >  B  >  C 

52  Cons: 

Yes 

Condorcet: 

A 

Fuzzy: 

A  >  B  “  C 

12  Cons: 

Yes 

1  Concordance 

1 _ 

Sublists 

Mean: 

20 

Sun  Sq: 

32 

Coeff  W: 

0.16 

52  Cone: 

No 

12  Cone: 

No 

7J 


I 


1 


TABLE  7.  MODEL  VALIDATION  WITH  LITERATURE  -IV 


7? 


Copeland 


Case  3  P.ef :  Richelson  (31)  p.  174 


Qty 


Sublist  Orders 


y  >  x  >  Ax  >  A2  >  Aj 

A3  >  A2  >  >  y  >  x 

x  >  Aj  >  A2  >  >  y 


Answer:  Copeland:  x 


Aggregation  Orders 


Borda:  x>y>Ai«A2"A:j 
Pref :  x  >  y  >  Ax  -  A2  -  A3 
Fuzzy:  y  >  x  “  A^  *  Aj  “ 
Cooeland:  x>y>A1»A2-A^ 


Consistency 


D  -  3.5 
zeta  "  0.30 
52  Cons :  No 
1%  Cons:  No 


Concordance 

Sublists 

Mean: 

12 

Sum  Sq: 

8 

Coeff  W: 

0.05 

5X  Cone: 

No 

12  Cone: 

No 

TABLE  7.  (CONTINUED) 


Copeland 


Case  4  Ref:  Richelson  (31)  p.  174 


Qty  Sublist  Orders 


3  y  >  J  >  Aj  >  A2  >  Aj 

*3  >  A2  >  Ax  >  y  >  x 
x>A3>A2>Aj>y 


Answer:  Copeland 


" 

Ag^reg,  'ion  Orders 

Consistency 

Borda:  x>y>A^>A2>Aj 

o 

* 

o 

Pref :  y  >  x  >  A^,  >  >  A^ 

zeta  ”  1 

Fuzzy:  y>x>A^-A2"A_ 

5Z  Cons:  Yes 

Copeland:  y>x>A^>A,  >A^ 

1Z  Cons:  Yes 

Mean: 
Sun  Sq: 
Coeff  W 
5 Z  Cone 
1Z  Cone 


Concordance 


Sublists 

Borda/ 

Pref 

wm 

Borda/ 

Copeland 

15 

6 

6 

6 

34 

28 

34 

38 

0.136 

0.95 

0.944 

0.K 

No 

Yes 

No 

Yes 

No 

No 

No 

No 

Copeland 


Case  5  Ref:  Richelson  (31)  p.  173 


Qty 

Sublist  Orders 

1 

x  >  y  >  T  > 

W  > 

z 

1 

x  >  y  >  z  > 

K  > 

T 

1 

y  >  w  >  z  > 

T  > 

>: 

1 

T  >  z  >  W  > 

X  > 

y 

Answer: 

Copeland: 

y 

Aggregation  Orders 

Consistency 

Borda:  v>x>z“H«T 

D  -  3.5 

Pref :  y>x>z“W“T 

zeta  *  0.30 

Fuzzy:  x>y“z'W»T 

52  Cons :  So 

Copeland:  y>x>z«W“T 

12  Cons :  So 

Concordance 

Mean: 

Sum  Sq: 
Coeff  W: 
5a  Cone: 


Sublists 


12 

8 

0.05 

No 


Borda/ 

Pref 


6 

32 

1.0 

No 


Borda/ 

Copeland 


6 

32 

1.0 

No 

No 


12  Cone 


No 


No 


TABLE  7.  (CONCLUDED) 


TABLE  8.  MODEI  VALIDATION  WITH  LITERATURE  -V 


Shannon  Preference  and  Others 


Case  I 

Ref:  Shannon  (32)  p.  xviii 

|  Aggregation  Orders 

Consistency 

Qty 

Sublist  Orders 

Borda:  A  > 

B  > 

C  >  E  > 

D 

D  -  0 

BUB 

A'C>B>E>D 

Pref:  A  > 

B  > 

C  >  E  > 

D 

zeta  «=  1.0 

H9 

B>A>C>E>D 

Fuzzy:  A  > 

B  > 

C  »  D  - 

E 

52  Cons:  Yes 

D 

A>B>C»D>E 

12  Cons :  Yes 

Answers: 

Borda:  A>B>C>E>D 

Pref:  A>j>C>E>D 

Concordance 

Coeff  W  -  0.84 

5Z  Cone.  Yes 

Sublists 

Borda/ 

Pref 

Pref/ 

Fuzzy 

Kean: 

9 

6 

6 

Sub  Sq: 

76 

40 

34 

Coeff  W: 

0.844 

1.0 

0.944 

52  Cone: 

Yes 

Yes 

No 

12  Cone: 

Yes 

Yes 

No 

85 


36 


TABLE  9.  (CONTINUED) 


Special 

Case  2  Ref:  Kendall 

(7) 

p> 

145 

Aggregation  Orders 

Consistency 

Preference  Matrix 

Pref:  A«C>B-E»F>D 

D  -  5.0 

1 

1 

; 

(Sane  Pref  Matrix) 

reta  ”  0.375 

Sun 

A 

B 

c 

D 

E 

F 

jZ  Cons:  So  1 

4 

A 

- 

1 

1 

0 

1 

1 

I 

1Z  Cons:  So  I 

? 

B 

0 

- 

0 

1 

1 

0 

1 

1 

4 

C 

0 

1 

- 

1 

1 

1 

! 

1 

1 

D 

1 

0 

0 

_ 

0 

0 

2 

E 

0 

0 

0 

1 

- 

1 

-  i 

|  Concordance  (S/A) 

2 

F 

c 

1 

0 

1 

0 

- 

i 

! 

| 

1 

1 

1 

| 

Answers 


mwfliHn 


«r:vw  trees  toe 


5e=tr  sttru 


easts  vote  bstafts  the  tied  *Hets»tis«  piris. 

3ori»'?  acic  appears  to  petals  either  istetjre.itiee 
tSee  Blade  {15)5.  the  literature  and  model  difier- 
cooes  in  the  Borda  methods  ease*!  ect  when  tie  colnan 
totals  are  subtracted  ft t*  tie  rew  totals  ia  the 
adjusted  Borda  method  . 


For  Ofcses  2.  5  *sd  7  tiasci  11,  the  asterisi 
!*J  at  the  sadist  e cocordanc*  resalts  denotes  that 
the  examples  indicated  contain  repetitions  of  sob- 
lists  soch  as  nine  stslists  of  Al  >  A2  >  A3  in  Case 
9.  5tr  these  cases,  the  repetition  cf  soil  ists  was 
isot  as  swltipiicative  decisicc-sater  ;odpe  eicits 
C*J).  the  rati  orders  are  the  six  bet  the  ssblist 
coocordassce  data  are  based  os  staple  occurrences  of 
each  type  cf  schlist  ci.e.,  three  soil ists  tested  for 
Case  9).  Since  the  coapoter  model  is  limited  to 
aggregate  1W  or  fewer  ssbllsts.  Case  1®,  with  142 
sshiisa  could  only  be  csepstea  by  the  jodge  we i pits 
approach. 


Case  13  presents  an  tmplt  which  is  intran- 
sitive  and  has  no  discrete  solution.  Scte  that 


the  model  handles  in transit: 


as  indifference. 


Finally,  >a  Cases  1-5,  15,  and  it,  the  cosputed  re- 
sclts  agree  with  the  literature  exaspics.  It  was 
cemclsded  that  the  node!  adequately  represents  the 
Borda  and  adjusted  Berda  majority  rank  methods. 


For  the  cases  of  Table  5.  for  Porda,  Condor- 
cet,  and  Bias*  method  examples,  the  Borda  resalts  are 
ccaoctsd,  and  the  Ccoburcet  results  are  observed  by 
scanning  the  rows  of  the  preference  matrix  for  zeros. 
If  a  taro  i other  than  (a  the  stain  diagonal)  exists, 
then  the  a'*tema*ive  does  cot  have  a  majority  over 
all  other  alternatives,  which  is  the  Cor.dorcet  cri¬ 
terion-  The  3iack  answer  is  the  Ccr.dcrcet  winner  if 


coe  exists- 


srset  winner  coes  net  exist 


the  Slade  winner  is  tie  Borda  winner-  A  strong  Gon¬ 
er  is  coi  that  beats,  not  ties,  all  other 


dsroet  wi 


alternatives.  For  Table  9.  competed  resorts  for  all 
ten  cases  agree  with  tie  literature  examples.  For 
Cases  2  *s=d  5,  tae  Borda  count  values  are  also  gives 
in  the  literates*  and  are  in^agieeaent  with  the  con¬ 


tactor  model  results. 


For  the  cases  of  Table  i,  the  Copeland  {!&) 
resells  are  obtained  as  the  preference  order  of  the 
node!  when  0,  1/2,  1  scoriae  constants  are  csed  for 


the  frequency  matrices  and  -1,  0,  1  scoring  con¬ 
stants  are  used  for  the  preference  matrix.  The  other 
results  are  obtained  as  they  were  on  Table  5.  Cases 
1,  2,  3,  5,  and  6  of  Table  6  have  total  correspond¬ 
ence  between  literature  and  computer  results  from  the 
rank  order  aggregations.  In  Case  4,  the  Copeland 
results  match,  but  the  Borda  results  do  not  match. 

No  explanation  can  be  made  unless  the  reference  is  in 
error.  Nevertheless,  the  model  is  validated  for  the 
Copeland  method. 

All  six  cases  in  Table  7  have  Copeland  results 
from  the  literature  and  the  model  that  fully  agree. 

Case  1  of  Table  8  has  full  agreement  between 
the  literature  examples  and  the  model  results.  In 
Case  2,  the  rank  orders  agree  but  the  sublist  con¬ 
cordance  figures  differ  because  of  an  error  in  the 
sum  of  the  ranks  for  the  F  alternative.  Dr.  Shannon, 
author  of  Case  2,  told  of  the  error  during  a  class 
lecture.  The  majority  order  of  Case  4  agrees  with 
the  computed  PREF.  In  Case  5,  the  intransitive 


majority  agrees  with  the  indifferent  orders  computed. 
For  Case  6,  the  last  dominated  rank  order  corresponds 
to  and  agrees  with  the  computed  PREF  order.  The  six 
cases  in  Table  8  validate  the  Shannon  preference 
method  in  the  model. 

Table  9  presents  special  cases  to  validate 
specific  functions  in  the  model.  Case  1  is  a  Kendall 
example  to  illustrate  the  ties  correction  calculation 
of  the  coefficient  of  concordance  when  significant 
ties  (indifferences)  are  in  the  sublists.  The  liter¬ 
ature  example  and  the  model  computation  of  Case  1 
agree  completely. 

Case  2  is  a  Kendall  example  to  illustrate  the 
number  of  circular  triads  (D)  and  coefficient  of  con¬ 
sistency  (zeta)  computations.  The  literature  example 
begins  with  the  preference  matrix  and  continues  to 
the  completion  of  the  consistency  evaluation.  The 
literature  example  and  the  model  computation  of  Case 
2  agree. 


Case  3  is  another  Kendall  example  to  illu-  In  summary,  the  literature  cases  and  model 

strate  the  calculation  of  the  Kendall's  coefficient  results  in  the  six  tables  represent  a  reasonable 

of  concordance,  W.  The  literature  example  and  the  validation  of  the  model, 

model  calculation  of  the  mean,  the  square  of  the 
deviations,  and  the  coefficient  of  concordance  all 
agree. 
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IV.  SUMMARY  AND  RECOMMENDATIONS 
A.  Concluding  Summary 

A  comprehensive,  flexible  model  was  devel¬ 
oped  and  coded  on  a  large  computer  to  accomplish  the 
sublist  aggregation,  weighting,  hierarchial  conver¬ 
sions,  requirements  translation,  and  results  evalu¬ 
ations.  The  coded  model  has  been  verified.  Vali¬ 
dation  has  been  successfully  performed  against  46 
examples  from  the  literature.  The  model  then  was 
demonstrated  for  an  extensive  R  &  D  projects  priori¬ 
tization  study  (Dobbins  4). 

Fuzzy  set  rank  order  methodology  was  briefly 
explored  and  added  to  the  model  for  am  alternative 
final  aggregation  rank  ordering.  The  methodology 
employed  was  too  insensitive  for  many  of  the  cases 
computed.  The  fuzzy  set  method  would  rank  many 
alternatives  as  indifferent  when  the  other  three 
methods  developed  preference  orders  between  the  same 
alternatives. 


3.  Research  Accomplishments 

In  reflection  on  the  research  reported  in 
this  report  and  Dobbins  (4,  5)  several  findings  and 
accomplishments  are  apparent  to  this  author. 

This  research  demonstrated  the  practicality 
and  limitations  of  several  majority  rule  methods  that 
can  be  used  to  aggregate  ordinal  rank  orders. 

Although  extensive  theoretical  research  has  strived 
and  generally  failed  to  ^nd  aggregation  methods  that 
always  give  transitive  results,  for  the  realistic  rank 
order  problems  examined,  intransitivity  was  not  an 
impediment. 

This  research  demonstrated  the  power  and 
limitations  of  a  large  computer  capability.  Impres¬ 
sive  problems,  beyond  the  reasonable  consideration 
of  hand  calculation,  can  be  accurately  and  quickly 
computed  when  iterative  solutions  are  not  involved. 
But  the  state  of  knowledge  and  equipment  limits  the 
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extent  of  usefulness  of  majority  rule  methods  to  not 
over  a  few  hundred  judges  and  alternatives. 

Specifically,  this  work  has  shown  that  diverse 
and  complex  R  &  D  management  priority  lists  can  be 
aggregated  into  a  useful  single  rank  ordered  list. 

C.  Recommendations  for  Future  Investigations 

Several  areas  exist  for  further  research 
work  to  improve  the  modeling  and  computer  coding  for 
the  aggregation  of  rank  orders. 

The  dimensions  of  the  computer  code  arrays  are 
limited  by  the  computer  capacity.  With  no  signifi¬ 
cant  changes  in  the  model,  the  present  100  x  100 
dimension  limit  could  be  enlarged  to  125  x  125  or 
perhaps  140  x  140,  but  little  further.  The  bene¬ 
ficial  solution  would  be  a  computer  code  that  was  not 
dimension  limited.  The  approach  might  be  to  develop 
a  computer  code  that  will  progress  through  very  large 


matrices  one  section  at  a  time  until  all  sections  are 
computed. 

The  present  model,  to  minimize  data  storage 
requirements,  does  not  hold  input  sublist  data  as  the 
computations  progress  through  the  arrays.  This  space 
saving  requires  that  all  data  be  re-input  for  each 
problem  even  if  only  a  single  control  value  changed. 
Again,  extended  space  capacity  could  remedy  this 
input  data  repetition  requirement.  Further  research 
might  find> other  remedies. 

The  COMPARE  subroutine  used  Kendall's  concord¬ 
ance  tests  to  evaluate  pairs  of  final  aggregated  rank 
orders.  Kendall's  concordance  method  is  necessary 
where  more  than  two  rank  orders  are  evaluated.  But 
there  are  other  methods,  such  as  the  Kendall's  Tau 
method,  where  there  are  only  two  rank  orders,  that 
could  be  considered.  An  investigation  could  deter¬ 
mine  if  the  Kendall's  concordance  test  should  be  re¬ 
placed  for  these  final  comparative  tests. 


APPENDIX  A 

FUNCTIONAL  PLOW  DIAGRAM 


97 


JMtpMtl* 


- ^ 


j  PHSCEDIJC  PAGE  SLO^-HOT  filmed 


The  functional  flow  diagram  for  the  aggregation  computer  model  is 
presented  in  Figure  A-l.  The  P  term  repeated  in  the  fiow  means  "print" 
the  information  about  that  step  in  the  process. 
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Figure  A-l.  (Continued) . 
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Figure  A-l.  (Continued) 


Figure  A-l.  (Continued) 


TABLE  B-l 


TECHNOLOGY  PLANNING  PRIORITIES 


Iliput  Requirements 

Card  Type  1:  Header  -  Name  of  priority  group 
Col  01-80 

Card  Type  2:  Control  card 

Col  05-05  *  NWT  -  Weight  type  (1-8) 

(see  SECTION  II  for 
descriptions) 

Col  10-10  ■  NC0HP  ■  Complete  all  matrices  if 
nonzero 

Col  15-15  *  NPTYP1  =  Type  of  calculation  for 
frequency  matrix 

0-0,  .5,  1 

1  -  -1,  0,  1 

Col  20-20  -  NPTYP2  -  Type  of  calculation  for 
preference  matrix 

0-0,  .5,  1 

1  -  -1,  0,  1 

Col  25-25  -  MATR  »  Self  evaluation  key 
0  «  No  self  evaluation 


1  »  Self  evaluation,  complete  matrix 

2  »  Self  evaluation,  threshhold,  reduced 

matrix 

Col  26-30  »  THLD  =  Percentage  level  under  which 
elements  are  discarded 

Col  35-35  =  NPRINT  ~  PRINT  control 

0  »  Print  all 

1  =  No  print  of  sublist  frequency  matrices 

2  ■*  No  print  of  sublist  frequency  matrices 

or  weighted  sublist  frequency  matrices 

3  »  Same  as  NPRINT  -  1  plus  no  print  Fuzzy 

4  »  Same  as  NPRINT  =  2  plus  no  print  Fuzzy 

5  =  Print  only  input  and  output 

6  »  No  print  Fuzzy 
Card  Type  3:  Input  Type 

Col  5  =  JELE  »  Element  code 

0  -  End 
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TABL£  B-l. 

1  «  Requirements 

2  -  Projects 

Col  10-20  »  NELE  -  Element  type  name 

Card  Type  4:  1  -  NBR  NBR  «  Number  of  require¬ 

ments 

Col  03-05  «  K  -  Element  number  -  Number  between 

1  -  NBR 

Col  11-30  «  NAM  «  Element  name 

Col  31-40  »  WHI  »  Row  uelght 

Col  41-50  -  KAT  -  Category 

Terminate  element  cards  with  "END"  in  Col  11-13 

A.  Element  number  and  name  are  required.  If  the 
weight  or  category  factors  are  blank,  they  are 
assumed  to  be  0. 

B.  If  a  weight  type  is  assigned  in  Card  Type  2,  a 
weight  factor  must  appear  on  the  project  card. 

If  the  projects  are  not  weighted,  but  the  judges 
are,  then  use  a  one  (1)  on  each  card. 


(Continued) 

Categories  are  used  only  in  the  cases  where  one  or  more 
of  the  evaluators  uses  a  judge  conversion  factor  of  9, 
10,  11,  or  12.  In  which  case  the  CATEGORY  (KAT)  groups 
certain  projects  or  requirements  together.  If  the  pro¬ 
jects  within  a  category  are  ranked,  they  must  appear  in 


their  ranked  order. 

Element  Number 

1 

2 

3  4 

5  6 

7 

Element  Name 

A 

B 

C  D 

E  F 

G 

Element  Height 

Element  Category 

1 

1 

2  2 

2  3 

3 

The  foregoing  example  implies  that 

1>2,  3>4>5,  6>7. 

The  final  order  of  the  requirements  would  depend  upon  the 
ranked  or  unranked  state  of  the  categories.  If,  however,  the 
requirements  are  specified  unranked,  then  the  foregoing  example 
would  imply 

1-2,  3-4-5,  6-7 

and  again  the  final  order  of' the  requirements  would  depend  upon 


109 


m 


ts'H 


TABLE  B-l .  (Continued) 


the  ranked  or  unranked  condition  of  the  categories. 

Sublist  Data  Card  Sets 
Card  Type  5:  Card  1 

Col  01-10  -  Judge  »  Name  of  judges  or  office 
making  rank 

Col  14-15  »  JCONV  =  15  Type  of  project  con¬ 
version  (see  Appendix  B 
for  descriptions) 


equal  elements  all  less  than  the  last 
given  element. 

4  Input  reduced  sublist.  Program  will 
complete  SL  at  the  beginning  with 
equal  elements  all  greater  than  the 
first  given  element. 

5  Input  rating  values  in  real  numbers 
given  in  the  order  of  project,  e.g., 

ABC 


Col  16-20  "  WTJ  “  Height  factor  of  judge 

Col  21-25  ■*  ISEM  =  100  percent  weight  factor 
for  self  evaluation 

A.  Judge  Name  -  Name  of  evaluator  must  be  present.  If 
the  JCONV  or  WJT  left  blank,  they  are  assumed  to 
be  zero. 


1,  2,  3,  etc.  Program  will  arrange 
projects  in  order  of  highest  to  lowest, 
setting  equivalent  elements  equal. 

6  Input  Julian  date  of  projects  in  order 

of  projects.  Program  will  arrange 
projects  in  order  of  soonest  to  latest, 
setting  equivalent  elements  equal. 


B.  If  the  JCONV  is  specified,  the  program  looks  for 
specific  data  in  Card  2  -  Free  format  sublists. 

JCONV  Input  Requirement 

1  Normal  input 


7  Input-3  Freeform  sublists 

Card  A  Key  element 

Card  B  Secondary  array  to  be  Inserted  into 

primary  array  after  key  element. 


2  Reduced  sublist 

3  Input  reduced  sublist.  Program 
will  complete  it  at  end  with 


Card  C  Primary  array  -  Program  inserts  secon¬ 

dary  array  in  primary  array  checking 
for  duplication  of  each  element. 
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S  Input-3 
Card  A 
Card  B 

Card  C 


9-12 

9 

10 

11 


m 

5§3§ 

if 

5 

gSfls; 

| 
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m  - 

.1 

; 

|| 

* 
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ff 
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TABLE  B-l.  (Concluded) 


Freeform  sublists 
Key  element 

Secondary  array  to  be  Inserted 
Into  primary  array  before  key 
element. 

Primary  array  -  Program  Inserts 
secondary  array  In  primary  array 
checking  for  duplication  of  each 
element. 

Categories  must  be  it'eclfied  In 
project  cards. 

Input  ranked  categories  -  Cate¬ 
gories  must  not  be  equal.  Pro¬ 
gram  checks  for  ranking,  then 
groups  ranked  requirements 
by  category. 

Input  unranked  categories  - 
Categories  must  be  equal.  Pro¬ 
gram  checks  for  ranking,  then 
groups  ranked  requirements  by 
category. 

Input  ranked  categories  - 
Categories  must  not  be  equal. 
Program  checks  for  ranking,  then 
groups  unranked  requirements  by 
category. 
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C. 


Input  unranked  categories  -  Categories 
must  be  equal.  Program  checks  for 
ranking,  then  groups  unranked  require¬ 
ments  by  category.  (If  categories 
are  improperly  input,  an  error 
message  is  written  and  the  subllat  is 
dropped  from  calculations.) 


If  weight  type  factor  appears  on  Card  Type  2,  a  weight 
factor  must  appear  on  the  evaluator  card.  If  projects 
are  weighted,  but  not  the  judges,  then  use  a  one  (1)  on 
each  card. 


Card  Type  6: 


Card  Type  7: 


Card  2  -  Free  format  sublist  ranks  by  project 
number.  Sequence  indicates  preference,  prefix  with 
with  minus  to  indicate  equal.  Terminate  list  with 
an  asterisk  (*) .  Follow  special  rules  fot  specific 
JCONV  outlined  above. 

Self  evaluation  of  expertise  in  the  technical  field 
of  each  input  element.  These  ratings  must  be 
between  zero  and  ISEM  in  the  element  index  order. 

Use  Card  Type  7  only  when  MATR  *  1  or  2  (Col  25 
Card  Type  2).  This  is  a  free  format  list  of  integers 
terminated  with  an  asterisk  (*) . 
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APPENDIX  C 

CODE  LISTING 
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The  FORTRAN  IV  code  listing  for  the  model 
computer  code  is  presented  in  Table  C-l. 

Between  each  subroutine  of  the  code  are  refer¬ 
ence  information  about  the  code  to  aid  in  tracing 
through  the  logic.  Of  special  benefit  is  the  list  of 
variables  and  the  locations  where  they  will  be  found 
in  the  code. 


The  key  variables  are  defined  in  the  comments 
of  the  subroutines  where  they  are  first  used.  INPUT 
contains  most  of  the  variable  definitions. 


The  INPUT  subroutine  also  contains  conments 
which  specify  the  formats  of  the  input  card  types- 
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TABLE  C-l. 


035TZ«  T*/T*  0*1*1  ft  ACC 


*1*  4.5*434 
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jOI  ;4f  J  «c  3058X*«S  /  h.  JO*-S 

SCO*Ur 

♦  •  J«*A*H;;i»,sSi:CUJl»,J50Ai  JiCv.WXI 

COMICl/Hf  L*/ftV  «X NO  13891. JCAT  (38  A I  .4  A*  (2) «  JC*f £*(386) , 

COMiCA/ KANNSUSTCdCC, 2). LIST  (1801  *08  (31 
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C 
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T**l 
TP*: 
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T**t 
I**t 
|p*t 
TP*  I 
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IP»I 
TP*| 
TP*; 
TP*! 
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TPPX 
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T**J 
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T**X 
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T**l 

T**l 
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TP*1 


15 

1* 

XT 

X* 

19 

2e 

?x 

2? 

?J 

24 
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27 
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- - — 

244S  TAAC4 

TWT 

_ 

M1TCS 

22 

37 

44 

45 

44 

52 

51 

HI 


5? 

A* 

111 


4114  TAA£5 


119 


"ABLE  C-l.  (Continued) 


t*55*:*  yittms  t4 /?*  o*i»i  ru^ 


C057l«f 


T*M  4K5 


Cor 

7423 

7U27# 

147?l 

04  j:  4 

1*4.142  -WCII045 

x«ts 

UUlt 

514: 

14 

•%*- 

15 

44?. 

14 

427  2 

45* 

4224 

$41 

4ll* 

ill 

•  5$2 

44* 

4371 

441 

4453 

4*2 

• 

419 

- r 

*55 

44*1 

42; 

44X5 

425 

4454 

535 

- -f 

42* 

4 

41’ 

-*t» - 

HfWlCM 

ill 

ttf- - 

21 

24 

1M 

» 

H 

-  -*** - 


ff*C 


442$  til  *4r 

•417-  tit 
Mil  1*1  *41 

•Mf  -444  «4T 

4441  947  rlf 


4472  444 

-  4724  44? 
7422  »1 

7154  444 
714$  441 
—7122  442* 
4724  444 

‘  4791  44T 
4745  442 
7*t«  "441 
744i  444 

"7175  444 

-t«rs  um 

4214 

—4 22C - 

4255 

—5245 - 


«4T 

*-T 

•ni 

*4T 


74  T 

747 

»4T 

**T 


I ’Of  I 
•  J 


*  J 
•-? 


1  X4Ttr»l 

Off  UK 

144 - 

14 

115 

::7 

54 

45 

42 

44 

74 
•  5 

41 


12% 

XU 


44 

44 

41 

154 

142 

“I-J4 - 

55 

54 

44 

45 


11K  *ff€*t*Cf? 

124 


4£ff*t»CC5 

-  rtr - — 

145 

194 

111 

35 


•  5  44 


4* 

lit 

Z24 

-iJt* 


155 

i4f 


rtciHio 
57  57 
4«  41 
45  4$ 
4t  4t- 


tfWOTw  *407(47X25 


44 

45 


C*T  ntft 
-trt  K»i- 

crr  *trs 


TABLE  C— 1.  (Continued) 


PROGRAM- 00 09 INS - 7%/7%  —OPT*l -TRACE - 


FTN-%.6*%39 


LOOPS — LABEL 
625% 

— 526% - 


6225 

-&3A5 - 

6313  620 

6321 — fri» 
6333  615 


INDEX 
*  J 

-*~d - 


FRON-TO  LENGTH - PROPERTIES- 


•  J 

•  J 

•  I 
J 


52  52 
-55  SE 


-55  - 
59  59 
-62  62 
65  93 
66-69- 


%8 

-%8- 


6%00 

-6%2fl - 

6%3C 

-6%f% — Mo- 
6507  610 

-65L7 — Mf- 


-*-9- 

•  J 

-*—Jh 


6537 
— 655% — 620 - 

-eOHHOM  8L0CXS 
CO  AT  6 

- HELP - 

RANK 

- 100 


*  J 

*  I 

- 9- 

*  I 
*1 


/  / 


-length 

21306 

- 966- 

*:z 

1% 

10202 


STATISTICS 
- PROGRAM  LENGTH 


71  72 

Mr  M  M 

wr  of 


%9 
-  %9- 
1%08 

- 38- 

38 

—110 


- INST AC K- 


EXT  REFS 
-EXT  RCrS- 
EKT  REFS 
EXT-REFS- 
EXT  REFS 


NOT  INNER 


INSTACK 


63  63 
91  91 

H-6— 12%- - 

126  130 


133  133 
136  1%1 


HB 

-119  -  - 
118 

238 

-  mn 

*«o 

10B 

168 - 


EXT  RCrs 
EXT  REFS 

extrefs- 


-  INSTAOK- 


EKT  REFS 


OPT 


NOT  INNER 


EXT  REFS 
-EXT— REPS- 


BUFFER  LENGTH 

- 6N  LABELED"  CONNOH-L ENGTH 

CN  BLANK  CONNON  LENGTH 


-231%8 


-1226 


6151B  3177 

— 5%1%5B  -  -22629  - 
237328  10202 


TABLE  C-l.  (Continued) 


7*/7*  0»l»:  .»*cf 


•1%  i.tni*  s/k.i: 


J**yf  SurOvti** 

«»  »»*:i*i5 

wo  oisc»;7>!3« 


Sc* 

•Cl* 


■*X*«XI 

•  IT 

**x 

*ee«M 

amz 

cut 

**c 

*T*X*T 

JW 

-XO*v 

Ktn 


tin 

■I 

«j 

4 1ST 

tXJTC 


CdvMl 

*»D1  *WI-  C«wf  h«!«»( 

*w*C«  Of  <S.£*f*IS 
:«ct  c*  ti<««x 
cu««i  »c:o*?  *«ct^  •*«•! 

C*»ttc*r  -£U*(i it  fc*?v* 

•£SC«T  »T*£-9*f*an 

ticto* 

*w;  f&*  cxntTjc* 

*«9«v  «i»:«  i»*<  c^v(ni9« 
«mn  tr»c  c:«y(ni9« 
j«w  sti#  c*U9*nx  »u: 
m*«»i  ic«ct  u*oc*  **:t-  th? 
ftW«M 

**1*11  CO*T«=L  ftxe. 

***•£  J»  CvUuATO* 

JiftM  cc*»£*s:j«  «(*  ro  im«ct 
o*i*  :*xo  rj*^»r 

J«y  *CXC*«7  713734  IC3iib«) 
t*t  *m»T  *tcT«*  *-t 

ccac  »»  x**ox  rv»(.£.c.. ^ejects 
c«  *£at,:»c*f*ts 

J5W  5flf  ((U.UT1M  nrtMia 
•5**lt(3  CGTTaf  «-#C*  -•** 

«£»  £l!*<9f  »«  «CM*  «7  <H*  - 

«Wt:*3«*  57  Ut'ltTtS 

14t*7  07  X*OC*CS  07 

IStli  ftCXM*  07  »»CJ£CIS 

■***l’*v^  «e^c*  07  JtM(2 

14MT  C7  J«CiS*  «KS 

7***T  07  **5  m  *•$  Nw- 

o«c* 

*****  C*  *U  c*5£* 

*•11*  C7  U;  KJjClt*  MM  C*3?« 
•MV  57  Ut*C«T  *M(t 
7t*f  13  C«XT  7y77f 

M*»»  C7  T<  W*H»  07  Xt(««tS 

£*C«  JJX.C  t*«!5 

MW£«  07  a(*£«TS  »Wt3  If  Ml* 

I*  t*C"  Mm  0*37* 

»Ut  C7  sctftf  (TSttflfXO*  VUKJ 

+*»o  er  #*•*  -  — - —  - 

*****  07  UWI.T  KXC«t$ 

»Mi*  07  jrr.f 

*****  C7  £U*»>:?  70*  co**cxm  H« 


*tt*t  C7  CU*C«T5  *C*  T*f  tf«C( 

tw>tsite  mm  oo5C*j - — 

07  T*<  cs«*cs:rc  MM  o*o<*s 


IM; 

**♦1 

1*7 

»**t 

:*♦ 

t^5t 

1*4 

i«W9»K 

«*•* 

*55 

fT*t 

1M 

30Mf«S 

*T*t 

*4? 

•®*4I*S 

T**t 

t4* 

:*Tirr 

tT*l 

XX* 

:mvt 

»**} 

145 

x«^ot 

»**I 

*44 

1%—j* 

X**: 

X57 

t**i 

IM 

!<M* 

f**: 

*?4 

1**WT 

X*Tj 

1M 

t«*ot 

*»*t 

:*: 

*•*»» 

WX 

X47 

!**3l 

»*•: 

2*J 

:w*ut 

*t*i 

:t* 

IUlT 

**** 

»** 

S^OT 

*44 

X*-  JT 

>**1 

t47 

x«*«t 

tt»: 

:4« 

I«*«T 

x**: 

14* 

1«W 

t**x 

*  xt 

t»9f 

»Ml 

*7: 

I«^0T 

XT*: 

:7? 

:«mvt 

TT*X 

:tj 

i«mut 

TT*l 

XT* 

t"*OT 

TTMJ 

:75 

X«*OT 

xt*x 

%n 

fVT 

»T*I 

:»7 

X^Ot 

»t*: 

:r* 

I^WT 

xt*: 

174 

Xt^UT 

XT*  l 

tit 

T*#; 

X«1 

X^WT 

xt*i 

*1? 

l<79f 

xt*: 

tM 

:«7UT 

TT*i 

St* 

t*#UT 

XT*t 

115 

XHTMt 

xt*: 

1»4 

!W 

T**l 

*47 

:»»¥T 

xt*: 

*•• 

w 

— 

xt*: 

14* 

Sit 

X*^OT 

xt*: 

*41 

1*#*T 

xr*t 

*M 

n«t 

xt*: 

SIX 

xt*: 

*14 

*XM¥T 

*T*1 

115 

I^BT 

xt*i 

1M 

I»Mol 

it*: 

*47 

OMCf 

xt*i 

*44 

woe* 

xt*: 

11* 

MX* 

X**l 

7M 

*•*£* 

xt*: 

Mt 

oooc* 

xt*j 

711 

x22 


TABLE  C-l.  (Continued) 


1 

7%/7*  OPT«|  TRACE  FT*  *.6«*3S 

16.30. 

*■ 

. 

CS  ■  CMX-SCUA»£  STATISTIC 

PREF 

TPP1 

213 

- - 

C 

C  •  MENOAli  O  ^*ft-Of-OMOU4AP-MIACS-1M 

ftftEF 

IPO| 

264 

49 

; 

Mtf 

f*cr 

TPPI 

zas 

; 

OS  •  VALUES  of  KCHOAU  0  AT  RANGE  LfVftS 

prcf 

»PP* 

206 

j 

LAB  •  LABtL  fOt  RANJE  Of  XENOALL  0 

PREF 

TPPI 

TOT 

— 

3 

gnu  •  octrees  or  freedom 

PPEF 

T»P| 

TO* 

c 

nr  •  number  er  fractional  sums 

PREF 

TFPl 

::s 

— 

- M 

c 

f.  .**4f-4*N*-|S  -NOT  CC*ttSI4Nl 

PREF 

IPPl 

?ta 

c 

PTCST  •  FIXED  CtlltCAL  VALUE  OF  P 

PREF 

TPPI 

211 

; 

ICTA  •  CO£Ff!C!£*ir  Of  COHSISTANC* 

PPEF 

TPPI 

212 

C 

A (I • J)  «  NORMALIZED  ftcoorncr  MATRIX*  * 

FUZZY 

TPPI 

21? 

— 

3 

TtACfC  •  sun  Of  THE  MA^OR  OUCOMAl  OF  AII.JI 

FUZZY 

TPPI 

214 

T9 

* 

MATRIX  SOUAREO 

FUZZY 

TP*I 

21s 

— 

■  - 

f 

TMC{  €--•  SUH-Of-THf  «iPOft-OIRCO*A4— - * 

FUZZY 

?PP| 

216 

z 

MATRIX  •  A (I « Jl  TRANSPOSED 

FUZZY 

TPPI 

212 

c 

FR  «  AVERAGE  FUZZINESS  IN  A 

FUZZY 

TPPI 

2IB 

; 

CR  •  AVERAGE  CERTAINTY  In  • 

FUZZY 

TPP| 

?15 

75 

c 

S  •'SUM  Of  OEVIAT  IONS ‘SQUARED 

CONCOR 

TP®  | 

220 

z 

C  «  K£  MO  ALLS  COEFFICIENT  Of  CONCORCAnCC 

COMCOR 

TP»l 

221 

— 

— - - 

e- 

RSAR- - ♦—  -N£AN - — - - - - - — 

CONCOR 

TPPI 

222 

c 

P  •  PROBABILITY  Of  RAM  ORDER  COKCRDAnCE 

CONCOR 

TPPI 

223 

3 

NELC  •  MUME*  Of  ENTRIES  CN  TNOfr 

REQUIRE 

TPPI 

??4 

15 

z 

TPPI 

225 

c*** 

INPUT  OATA 

TPPI 

2»* 

5 

TPPI 

227 

— ■ — *- 

— -  - 

C*. 

CAROS  1-TmUNtR’ - — - - M>»»{ ft -  Of  PtfdUECTS 

TPO| 

274 

; 

COL  03-65  •  X  •  ELEMENT  NUMBER.  NUMSER  BETmCEN  t  ***0 

MBR. 

TPPI 

229 

— 

*> 

C 

11-30  •  NAM*  CwIMENT  NAMt, 

TPPI 

230 

z 

36-40  •  MHt  ■  ROM  MEiCMT  f».0 

TPPI 

231 

- 

z 

4*-#f  «  'AT  •  CATEGORY  IS 

YPPl 

232 

c 

TERMINATc.  Pfy^fcCT  CAROS  MIT*  **£*0“  IN  COLS  UMI* 

tPPI 

233 

90 

CONTROL  CARO 

IPPl 

234 

235 

— 

z 

COt  65-65  •  NRT  •  MCI  GMT  T«rP£  t  ThRu-6- 

TPPI 

236 

z 

0  •  MO  MCXCnTS 

TPPI 

237 

- — 

— 

c 

COt  16-1#  •  NCOMfp  COMPLETE  Att  RAfftlCCS  If-  NON  ZERO 

TPPI 

23# 

__  ^ _ 

_ j 

COL  15-15  «  NPTYPI  -  FREQUENCY  MATRIX  TYPE  CONVERSION 

TPPI 

21S 

c 

i  ■  0..5.1 

TPPI 

2H 

- - 

— 

c 

1  •  -l*0»t —  -  - 

TPPI 

242 

3 

COL  25-25  «  HAIR  -  SELF  f VALUATION  <£Y 

TPPI 

243 

— - — 

- 

—  ; 

•  •  NO  Sft^F VACUA  1 ION  - 

TPPJ 

244 

IOC 

_ * 

X  ■  SELF  EVALUATION  COMPLETE  MATRIX 

TPPI 

245 

C 

26-30  •  TMLO  -  LEVEL  UNDER  MHtCM  THE  ELEMENTS  ARE  OISCAROCO 

TPF  • 

?H 

247 

— 

3 

COL  31-35  •  N PRINT  -  NO  PPXNT  N£Y- 

TPPI 

246 

C 

0  •  PRINT  ALL 

TPPI 

246 

■ — 

iff* 

c 

1  •  MO  MINT  CP  SUB-LIST  FREQUENCY 

MATRICES 

TPPI 

260 

s 

2  •  NO  PRINT  Of  SUB-LIST  FREQUENCY 

MATRICES 

TPPI 

251 

- 

--  —  — - - 

—  3- — 

- - - - - - -flft-tfC-MMfC*- SUO-U5T-fRfO«€NCV-NAfRIO€S 

-TPPI  - 

252* 

3 

3  •  SAME  AS  NPRINT  •  1  PLUS  NO  PRINT  FUZZY 

TPPI 

2*3 

C 

4  •  SANE-  AS  NPRINT  *2  PLUS  NO  PRINT  FMZY 

TPPI 

254 

113 

; 

5  •  PRINT  ONLY  INPUT  AND  OUTPUT 

TPPI 

25? 

: 

-6  «  NO  PRINT  FU22P 

TPPI 

256 

i 

TPPI 

257 

•  "TPP* 

255- 

; 

CARO  i 

TPPI 

255 

Sb 
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V 


TABLE  C-l.  (Continued) 


7 6/2%  OPf*t  TPACt 


FTN  *.6*639  5*/l#/»0  l6.36.3b 


I 


0- 

c 


col  01-10  «  auocc  •  hknc  of  juoce  or  ornce  HAKXMC  «n<  no 

—  -  cot  i6-ts  •  jco*+  *  ir **-**-+*+ rtd  toinnsio*  —  is 

COL  16-20  ■  NT J  •  MfICMT  FACTO#  OF  JUOCC  F5.C 

COL  1 1-25  •  I5EH  -  ItO  PERCENT  NC  ICMT  FACTOR  FOR  SELF  CVALUAtXON 

CARO  2  •  FREE  F0M4T  !  JS-LIST  RAN<3  ST  PROJECT  NUHSCR. 

SEQUENCE  INDICATES  PREFERENCE.  FRCFE*  «T M  NlNUS  TO 
-IN0!CAT<'ftUAtT-f«wmTe-U3?-«*I»^^N 

CANO  3  «  FREE  FORNAT  SELF  EVALUATION  LEVELS*  ONE  FOP  EACH  PANKCO 
ITCH  IN  ORDER.  HOST  8E  LESS  THAN  0»  EQUAL  TO  IS£N.  LIST 
MUST  •£  ENDED  NltH  AH  •. 


SUflNOUfIHE  - 

CONHCN  /COATA/  HSR  .NJ.NNT.  HAHE  I2.356)  •  A tltO  *  1901  •«!(  3s  C I  *WJ(  1.  :• 
*  .  JNAHEI101)  .NSIZEUItl.JSUBLtlOO.lOll 

COHNCN/IOO/MfADCRIi) .N0TC0N«NPTVP1,NPT?P2,NFU2.NP#XnT,JTI£ 
CONNCN/HELP/Ny*IHD<JIO>,XCATI3IOI,MNf2l,  JCH£C«<3C0».XfT.lNA».  JHA* 

COHHCN  /NORK/X  (101. Ill)  tSUHA  (396 )  . JRANK( 106 )  .JPREFClOH 
Of HE NS I  OH  SUNS  (301 > 

NEAL  rvALUCUOl) 

LOCK  -v  ERROR.  JERR.  EOF 

'DATA  E*RO*VcFAt3t»P-»-  Jt**t*+*t*tr+ - 

DATA  NQT/“  .  •/.  *»EQ/“  »“/ 

CLEAR  u'Tft 
J1AX»1P0 
XNAX«360 
ERROR  •  .FALSE. 


NOTCCH  •  I 
00  10  Jat.XNAX 
Hit J)<1. 
lNOtJ»-fl 
19  ICAT(JI»0 

- 00~11-4»1tAH*X — 

NJCJJ-l. 

©0  11  I-i.JNAX 
11  AIX»J)*0»0 
NJ  *  0 

DO  IS  R  *  1.101 

NSXZE(K)  •  • 

DO  tf  4*1.100' 
ESR(J.<»*5. 

IS  4SUSLT4.K)  •  0 


-  READ- CONTROL'S  *  - - 


READ  (9.912)  NMT.NCOHP.NPf yPi»  NPT YPZ.HATR. THLO.NPPXNT 
HRXTE  T6.916I  NNT.NPTYMtNNTrR?,NATR.T"t’J.NR*INT 
912  FORNAT IM5.FS.2.XS) 

116  FORKATt/-  HHT»-,X2i3*."nPrm»*.ir43*.*HFtYRt»“*t^3R.“nATR*“.I2.J 
•X."TNLO**.F6.2,3X,-NPRXNt*“X2/) 

-  -  if*- wco«r-i«cv  *-*-»- HEAOEtd)-*-  ‘■■esiPteiefr*- —  - -  - 

XF(  kCQNP  .HE.  0  )  NR1TE (6.9151 


TPPl 
TPPl 
TP*1 
TPP1 
fFPl 
TPP1 
TPP1 
TPPl 
TPP 1 
1**1 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TP®  1 
TPPl 
TPP  I 
TP»1 
TPPl 
TPPl 
tPPl 
TPPl 
TPPl 
TPPl 
TP®  1 
Tf  P  1 
TPP! 
TPPl 
TPPl 
TPP  J 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TP*1 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TP»i 
TPP  • 
TPPl 
TPPl 
TPPl 
TPPl 


2‘C 

261 

?6? 

263 

266 


>65 

266 

2bJ 


266 

*69 

2»: 

2n 

?)? 

2M 


2»6 

225 

*7b 

777 

Z7( 

229 

2*0 

2*1 

262 

293 

29*. 

26* 

>96 

292 

’»* 

299 

299 

291 

292 
291 
296 

295 

296 
2®2 
299 
299 
309 
391 

302 

303 
356 
J?5 
346 
307 
32* 
301 
JU 
Jtl 

312 

313 
316 

315 

316 
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TABLE  C-l.  (Continued) 


5U8WUTI-.C  INPUT 


7*/7c  OPT-t  TRACE 


9l5  FORMAT!/"  CONPl ETf  Alt  SUO-IISTS-/! 

If  I  •»**!  .«€«-•  .W.  -NWT  - - 

WRITE (6*91*l  NWl 

91«  FORMAT (-*-,T55,“*»  ERROR  IS  (ILCtAI.  WEIGHT  TTPC") 

N»r  •  o 
7  CONTINUE 
irr.o 

iNJaO 

NFU7-W 

OtpaSS  FUZZ*  IF  hEICkTEO 
If  (NWT.NE.O)  NfUZ«l 

tHO  OF  WEIGHTS 


C09  CONTINUE 

R£»3  15*9011  J£IC  «N£LC 

if  (jeie.eq.o.ano.jhj.gt.inji  notcch*i 
If  (JElE.EQ.O)  M9R-ITT 
If  uaC.EQ.O)  CO  TO  771 

-405  FORMAT  (l5.5*rPtO»- - - 

WRITE  (6*9111  NEU 

931  FORMAT  (/"  IMPyT  REAO  IN  "«Alt/» 

WRITE (6*90?) 

90?  FORMAT  (/-  I  WOE*  ElEXNT  »»AW€",lW**,,Wf"»t«l(**Ci 
:  RCAO  ELEMENT  INDEX*  WANES*  WEIGHTS,  CATEGORIES 

1-7  REAO  -(5,96*1  R,HA«t*»« !,«(*? - - 

99*  FORMAT  (1*,X«,$X,?A10,;X,F5.0,5X,!S) 

WRITE  (6,919)  5  *  NAN, MHI , V AT 

If C  NAH(J)  #£G,  “£Ntr  .OP.  K  .CO.  999  >  CO  TC  50 
If  (JClE.EWI  n?*< 
if  uac.co.i)  oxm* 

- If'RN.LE* JMARl— GO-IO  - 

WRITE  (6.9J6)  MAX 

906  FORMAT (•♦-,T55»,,*«  ERROR  **-INOE*  tARCER  ImAMMO-- 
ERROR  «  .TRUE. 

GO  TO  C%  -  -  — — - - - 

?0  If!  K  .CT.  0  I  CO  TO  ?5 

- «RHE(6*907I - 

937  FORMAT I"*-,TS5,-*a  ERROR  •*  XwCEX  LESS  THAN  l") 

ERROR  «  .TRUE.  - - 

CO  TO  CO 

-76IF6XN0 (*).€•.“«  »— GO  TO  *#-  —  —  -  “ 

WRITE (6 *% ll  Kt  MANE  (1«KI  *  KAWE<?*«) 

•  *  AS  ~.ZA1II 
— ERROR  •  .TRUE. 

CO  TO  CO 

30  XN9CK)  •  K 
- tCA««r*RAT- 


MAME (1 *5)  •  NAMI1I 

NANE(f.K)  •  MAM(?» - 

N*MA*I(M,K) 

If(  WHI  .ME.  **-)— Rl 
Ifl  NMT  .EQ.  7  )  MI  IK)  - 

-GO  TO- if - - - 


OC/96/AO 

t5. 36.34 

TPPI 

31) 

TPP1 

Ui 

TRR1 

319 

TPR1 

3?t 

TPPt 

3?1 

TPPI 

3?? 

TPPI 

3?3 

TRP1 

!?C 

TPPt 

3?5 

TPP1 

*76 

TPPI 

377 

TPP 1 

3?f 

TP*1 

3?9 

—  TPPI 

HR 

TPPI 

331 

TPPI 

33? 

TPPI 

333 

TPPI 

33c 

TPPI 

315 

TPPI 

)U 

TPPI 

337 

TPPI 

331 

TPPI 

339 

TPPI 

3C| 

TPPI 

SCI 

TIPI 

4*? 

TPPI 

3C3 

TPPI 

3CC 

TPPI 

3C5 

TPPI 

1C6 

TPRJ 

3C7 

- TPPI-  . 

-IcR- 

TPPI 

169 

TPPI 

350 

TPPI 

351 

TPPI 

35? 

TPPI 

353 

TPPI 

355 

TPPI 

356 

TPPI 

357 

TPPI 

35# 

TPPI 

359 

r*-TPPt— 

—  -AGO  — 

tpp: 

361 

TPPI 

36? 

TPPI 

363 

TPPI 

36C 

TPFl 

365 

- TPPI  - 

366 

TPPI 

367 

TPPI 

361 

TPPI 

369 

TPPI 

17# 

TPPI 

371 

-  TPP* 

-  '37?  —  -■ 

TPPI 

373 

125 


TABLE  C-l.  (Continued) 


lUORJulinE  input 


53  MS?  •  H 

if  fjctt.co.n  nsr*w5R-mt - - 

CO  SC  J»1.NSR 

trt  ino<j>  .ct.  o  *  co  to  to 

MRXTC(6.9i:)  J 

510  FORMAT  C-  ••ERROR**  NMAT  15  ELEMENT  NAME  FC*  !•.«*-. U» 
ERROR  «  .TPUE. 

SO  CONTINUE - — - - 


MR I IE  (6,941 »  hCAOE* 

)«X  FORMAT C“X-««*li/l 

-5 - — - PtRO-5UO-ttlT-RAMN5  AKO  itOKO - - - - - 

SCO  CONTINUE 

«CA0  (5.9301  JUOCE,  JCONV.  MNJ,  lSt* 

S3  FORMAT  Ui*  ,15  ,►  5.C  ,  15 1 

IF  (JUOCC.£C."EhC“>  CO  TO  *30 
IF  tJCONy. £0.999)  CO  TO  *.00 

- 'WRITE  <C*S5ft  JU0C«rJC0tnr*w«jftSfM - 

93?  FORMAT  l//"0-»Al0«4X*" JCONV  15  .4X*“  JUDGE  MEICHT 

•VALUE  UNIT  •-,»» 

IF (  MHJ  .EQ.  0.  .AMO.  MMt  .ME.  71  MM J  •  t.C 
IF  (t'ATR.NE.OI  NFU2«I 

- - 0tr-9tr-J»l'«WBR - — — — - - 

JRANR(J)  *  0 

50?  JCNECMJ)  ■  0  —  - - 

JERK  ■  .FALSE. 

PRINT  I*KS»,  IN J«tl 

- t-FORnAT-t/1»^TOTAt-M?R  ALT  «M5t5V<MHRtf  JWSt  "MSt — — 

IF  (JCOMV.CT.SI  CO  TO  SCO 

-  IF  (JCOMV.FQ..*.  ^.JCOMV.CO.OT  SO  fO-ftO- - -  -  — 

CALL  PRAt!  (FVALOf »NV, -N3R) 

C  - -  Rt'A?'FREE-F0RPAT-0ATR<  «M«‘S»>»-Lf5T*WIfM— •  -  - 

Z  CONNECT  10  XMTECEP 

If  ( JCQMV. EOt 5 » OR t JCONVi €0>6t ~ 90~TC  003  '  —i  '■  » 

St*  CONTINUE 

- 00-510  -  —  - - * - - - - - 

K  «  f VALUE (J) 

- t.-»-IA«SlKJ  — - - - 

IF<  L  .CT.  t  .AMO.  L  .LE.  NS*  )  CO  TO  5*5 


934  FORMAT 1“  ••  ERROR  ENTRY  NUHSEB,"X%* *  NAS 

- »  **PROOU€T-Of**»  15-» -  — - - - - 

ERROR  c  .TRUE. 

515  IF  I  JCHECKtL)  *EQ.  9  1  CC  TO  500 


9J3  FORMAT!"  ••  ERROR  ••%X5.-  ALRCAOT  RANKEO") 

- CRROR-w-iTRt*r - — -  - - 

JERR  -  .TRUE. 

- CO  -tC  5l»~ - - - 


NAS  XLltCAL  PROJCCT/- 


9W99/A0 

IS. 31.36 

TPPl 

m 

»PP» 

TPPl 

176 

TPPl 

377 

TPPl 

TP«*  t 

379 

TPPJ 

m 

TPPl 

TPPl 

30? 

TPPl 

303 

TPPl 

3Afc 

TPPl 

305 

TP»1 

3*6 

-  TPPl 

3A» 

TPPl 

3AS 

TPPl 

359 

TPPl 

J«C 

TPPl 

391 

tPPj 

39? 

-  fPPt  - 

- 593— 

TPPl 

394 

TPPl 

395 

TPPl 

396 

TPPl 

397 

TPPl 

3  90 

-TPPl  — 

-  399 - 

TPPl 

490 

TPPl 

401 

TPPl 

4»? 

TPPl 

4*3 

TPPl 

404 

TPPl 

400 

TPPl 

407 

TPPl 

40S 

TPPl 

409 

TPPl 

4  It 

TPPl 

412 

TPPl 

413 

TPPl 

414 

TPPl 

415 

TPPl 

416 

TPPl 

4t« 

~  TPPl 

419 

TPPl 

4  ?6 

-  *TPP1 

4?t  - 

TPPl 

422 

TPPl 

4?4 

TPPl 

425 

TPPl 

426 

JPREFCJI  ■  NCT 


TABLE  C-l.  (Continued) 


SU40VT!«e  INPUT 


?./7.  OPT-1  TRACE 


fTH  4. 6*4J4 


j4/;4/*5  1S.J4.J4 


jcnrc<iu 
ifi  «  .ir* 

540  C01I2HUC 


6  *  OP^Ef 4J»-»  4EO 


«nt;4.w»  <  gp«crn»«  o-t.iv  > 

1%:  fc+ntu/  /(26U2.I3I //il 


ChCC*'  f OR  CCKPtCTt.  SU4-LIST 

rus  ■  5 

00  51?  0  ■  l.NB* 

5i?  irt  jch£c<< j>  .eo.  i  i  ft««  •  i 
Ic  (FLAG. N£. Cl 

lf<  FLAG  .*€.  •  »  **|I€«4.9.#»-  - 

1*3  F3»HAt  I/-  SuHIST  IS  XNC01*tCTE“» 


Iff  OERR  I  CO  TO  559 
STORE  SUO-LIST 
NO  •  NO  •  i 

IN J)  •  - - - - 

hSWCInjj  :  Hi 
vjlkjl  •  wmj 
00  515  J  *  l.NV 
515  jsu9l ( j»h.'i  >  fmuEig) 

JCOHVI?  SU6LIST  HOT  COMPLETED 

IF  <OC0nY.€Q.2»  NO?COH«1 - -  -  — 

If  tgCOHV.EO.?)  C3  TO  54J 


IF  t JC3NV. ta. 3. Amo. *1T9. He. *.09. OCONY.fQ.*. AN0.H4T9.HC.il 
•WRITE  16.926) 

*23  FORHATI/-  SELF  EVALUATION  PROHIBITS  CONFECTION*-/) 

IF  IHATR.nE.C1  CO  TO  53. 

IF  tOCONV.Ef.  3.06.  jCO»V«€Q.4»- -60-10-546 - — - 


CO**Plt  T£  StfS-LtSf 
IFt  KCOnP  .EQ.  9  I  CO  TO  5*9 
*16  CONTINUE 

IFt  K1  .«.  N8R  I  CO  TO  $%8 


IF  <JCC*V.£3.J.0*.JC0Nf.C0.O  IN J* IHJ*  t 
IF  tOCOHV.MC.6)  CO  TO  519 
oconv«l 

nm  OVER  FOR  LEFT  INSERT 
00  512  g»t,nv 

-  -  -Nt*NB«-j4i— —  - - 

R2*NV-J*i 

514  JSU0L (Kl.N Jt- JSUBLIK? *N Jl 
H*J 

CO  516  0*1 »N6R 
CO  513  L>K1*n3? 

IF  10»EQ«XA9$<0C0it  TL  «NOf )rtC  TO  514 
513  CONTINUE 
«*N*t 

JSUiL tH*NJI»-J 
5XN  CONTINUE 

OSUtLtl.NOI-IAtSUSUBLtt.NJIS 
NVV«N9R  -  -  -  • - 

60  TC  532 


IFF! 
IFF  I 
TFfl 
IFF! 
IFF  l 
TFF 1 
TFPl 
T  FF 1 
TFPl 
TFF  1 
TFPl 
TFPl 
TFPl 
TFPl 
TFFi 


IFF  1 
TFFj 
IFF! 
TFFI 
TFFJ 
TFFI 
TPPl 
TFFJ 
TFFI 
TPPl 
TFF; 
IFF  1 
TF*1 
TPF  1 
TFFi 
TPPl 
TPPl 
TPPl 
TFPl 
TFFI 
TFFI 
TPPl 
TPPl 
TPPl 
TP*  1 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TMt 
TPPl 
TFFJ 
TP*t 
TFFI 
TPPl 
TPPl 
TPPl 


431 

41? 

433 

434 
.15 
4H 
437 
4U 
4  T9 

440 

441 
4*2 

443 

444 

445 

444 

447 

449 

440 

459 

451 

45? 

•5J 

454 

455 

456 

457 
449 
459 
469 
461 
46? 

463 

444 

445 

446 

447 

464 
469 
479 

471 

472 

473 

474 

475 

476 

477 
47? 
474 
44* 
451 
4  9? 
4*3 
444 
4*5 
446 
497 


TABLE  C-l.  (Continued) 


susnojun-:  i<*»ui 


?6/7*  OPT«l  t •ACt 


3«,/»  •/«%  15.16.36 


- — — 


Ml  CONTINUE 

:  JOONV-3  — - - - - 

:  <u«i  xnsept 

NT#  »  N* 

DC  533  <»1.N6* 

DO  521  J*1.NV 

If<  *  .CO.  uesc  jjublu.nji  I  I  CO  TO  53 

5?  J  CONTINUE  -  - 

mi  •  mi  ♦  i 
JSJBLINvv.NJ)  »  -  K 
5 33  CONTINUE 

JSU3KNTM.NJI  •  XJ6SI  JSU3L  <Ny»l«NJ)  » 

53?  CONTINUE 

nSimnjt  •  *»v  - - - - - 

Ml  m  N*V 

5 NO  CONTINUE 
:  SELF  EVALUATION 

53*.  CONTINUE 

If  <NlTf.CO.tl  CO'TOSt*— - 
CALL  PfAN  (S£N,HVt>NS3i 
DO  555  1*1. NV 

If  ISfPIXI.CT.tSENt  CO  TO  556 

555  COHTlNj,*. 

CO  TC  557 

556  UNITE  16  »3?tt *  — - 

»?I  fO.’tTT  <-  •••E«*0*»**  SELF  EVALUATION  LEVEL  MUTE*  Thin  too  P£*C* 

•NT*» 

CO  TC  525 

557  CONTINUE 
00  566  X*1.NV 

555  5ENtIl«SCn*l»/ft«*T1ISfNi*  - - - - ■ - 

00  557  I«l, HV 
00  5*7  J*1.HV 

5L7  IF  IJ.CJ.IAOSIJSUILII.NJIII  £S®  < I.Njl  «S£n< J» 

NNITE  16.5521  ICS* tl.NJI « !»;.NV» 

952  fClHIT  1/  /.15IF6. 2*101 

TWNE5H  HOtO  «if*XX  *£0VC?10*-«t-f~ev*tU*T-K>6-- 
Xf  UUTe.EO.l)  CO  TO  525 
00  565  I-l.NB* 

If  <ES*(I«NJI.LT.THLO)  CO  ;c  5*9 
CO  TO  565 


'jSUBL IX  »NJI  «f 
56*  CONTINUE 
l**3 

00  553  X-X.NB*  -  - 

553  If  IJ>U5L(X.TbJl.NC.il  m«n»i 

- - 

CO  5Si  I«l.*t 

If  TJSUtLtX.NJl.CO.BI -CO  TO'331- 
CO  1C  556 

531  If  CZ.CT.fft  CO  TO  350  -  - 

CO  552  J*X«N6A 

«*l  ~  — — - - - - — 

35?  JS06L  < J.NJI  *  JSUBL  I  J*i  •  NJI 


TM| 

633 

- T*M»i 

Pi* 

TPPJ 

636 

TPPl 

631 

TPPl 

632 

TP*I 

633 

TPP  | 

636 

TPP1 

6*5 

TPPl 

636 

TPPl 

637 

TPPl 

633 

TPPl 

633 

TP*1 

5lt 

TPPl 

5tl 

TP»1 

5*2 

TPPl 

561 

TPPl 

516 

TPP' 

565 

TPP; 

556 

—  ?PP3 

-55? 

TPPl 

53P 

TP#i 

503 

TPPl 

516 

T*f  1 

511 

TPPl 

512 

TPPl 

513 

*C*  T 

516 

515 

TPPl 

516 

*PP1 

517 

TPPl 

516 

-  TPPl 

513 

TPPl 

526 

TP*1 

521 

TPPl 

522 

TPPl 

523 

TPPl 

526 

TPPl 

5?5 

TPPl 

526 

TPPl 

527 

TPPl 

5?6 

TPPl 

9?9 

IJS  TPPl 

536 

TPPl - 

"-*31 

TPPl 

532 

TPPl 

533 

TPPl 

536 

TPPl 

535 

TPPl 

53€ 

TPPl 

53? 

TPPJ 

53« 

TPPl 

513 

TPPl 

561 

TPPl 

561 

TPPl 

56? 

-  TPPl 

36J 

TPPt 

566 

128 


TABLE  C-l.  (Continued) 


JwVJl'IIlt  Il»ut  ?*/?-  OM«i  TRACE 


FT*  4.V 


10 


-0) 


•.-5 


-13 


415 


-23 


*27 


-S3 


-15 


*.*.5 


%-5 


ii)  C34TIRUC 

if  iK.ea.it  50  to  «-  - -  - -  -  -  _  . 

If  (r.NC.N)Ki  Mt/tm 

Nsize«Nji*RV 
If  (K.RE.R9R)  -CC*lK*l 
5?5  CONTINUE 

:  *taum*tHTs  to  ftojEcis  transiaticr 

If  t.KX£.Ca.l»-«»-*0  liJr  - - -  — 

CO  VC  538 
1955  CUt  REQUIRE 
««X»C  <6.5511 

8>l  FORNAT  (//1X.~R£Q0IRC-CRTS  TO  PROJECTS  1»ANSIAT10R~» 

00  1CC3  IM.nv 

12*2  J4AN«(tt*»  - - ■ - —  - - - 

CO  1610  J»t.NV 
»j$uei  U'Sjt 

jRanr(ji*l 

JfRCF  <j>*nCT 

If  (KiLT.il  ^P*€F <■»»•* to  - -  -  -  - 

1111  CCNTIRUC 
J**€f  (!»■*• 

Mill  (6.551)  (JfREF (JI.JRARKJ)  .JM.MV! 

83  F0R4AT  */  /(26(*2.XSi//l) 

;  CO  READ  MORE  DATA 

60  TO  56)  — - -  - - - -  —  - 

53)  COnTJRuE 
RV*«M-1 

oo  681  Xei.inr 

531  SURA  (XleftOAT (It 
Z  JCOnv-3 

C  CONVERSION  OF  3AT4-T0  OEC€  NO  I  *6-0*068-  -  -  — - 

IF  (JC0NV.EQ.6I  CO  TO  625 

00  605  X>1.RVV 

R«XM 

00  665  J-H.RV 

xf  if v«lue i ji .lt.f value (lit  co  »c  Acs 

HOtO—f  VALV€  (Jl —  — - — — - - - 

SNOLC-SURA(J) 

FVAL0E(J)*F««LU£(I> 

SU«A(J)>SUI(A(X) 

F  VALUE*  X»*.*OL0  -  -  - 

SU1A<II»SmOL0 

6*5-C«Nll*»U€ - - - — - - - - - . - 

**3 

00  683  1*1, NV  ------ 

IF  (F  VALUE  (It  «£Q. 0.)  SUHAdlO. 

If  (SURA (II .Re. 6.1  H»N*1 

69T  CONTINUE 


*58  00  662  X>l*m 

2  IF  <fVALUe(I).Ea.fV*LU£4Z«lt»-SURA<lnt*-'SURA(I*lt - 

CO  TO  *50 

Z  JCONV-6  -  -  -  — 

Z  CONVERSION  Of  DATA  TO  ASCCROINC  ORDER 

*55  -  —  625  00  616  I-l.RVV - - — - - - - - 

R*1?X 


3-/C6/«8 

15. (2. 

tffl 

565 

TP»| 

AM- 

Tffl 

5-7 

Tffl 

?*• 

TR.  , 

5-5 

TRRl 

5«» 

t*M 

561 

Tffl 

*62 

Iff! 

555 

tffl 

55- 

Tff  1 

555 

TPRl 

556 

TRfl 

557 

t*f»- 

554 

If  f  1 

555 

TfPl 

563 

Iff  1 

<61 

IPPl 

562 

TP>1 

563 

Wj 

-  56* 

Tffl 

565 

Iff  1 

666 

TPf  1 

567 

Iff  t 

566 

TPf  1 

568 

TPf  |- 

57# 

T»»l 

57i 

Tffl 

572 

TPf  1 

573 

TP®  1 

57- 

TfPl 

575 

TP*  1 

576 

Tffl 

577 

Tffl 

57* 

Tffl 

578 

Tffl 

5*3 

Iff  t 

5*1 

— Tffl - 

— -5*2 

Tffl 

553 

Tffl 

<46 

Tffl 

545 

TffJ 

5*6 

Tffl 

547 

Tffl 

5<4 

Tffl 

588 

Tffl 

581 

TPf  1 

54? 

Tffl 

593 

-Tffl  - 

58* 

Tf»l 

595 

Tffl 

586 

Tffl 

597 

Tffl 

595 

tffl 

599 

-  tffl 

-  6*8- 

Tffl 

631 

129 


TABLE  C-l.  (Continued) 


SUM)UtK 

lH»Jf  7*/7*  0*!»|  t**Ct  Mu  *.*♦*!* 

JWW'48 

14.M. 

oo  6i3  j»h,i* 

TM I 

*V 

- 

If  IfVALVf  iJi.c7.rv*tott!»»-60  TO  *t* -  - 

»PP1 

*53 

H0i0*rmuc«J> 

tfPl 

*74 

460 

TP*1 

4)5 

f*Xlt£(JMf*ALU£<II 

TPPl 

43* 

SyH*<JJ«SUnAt!l 

it*: 

6*7 

FTlLtt«II»H0CS 

TPPt 

66* 

SU4A«Il.S*OtO  —  —  - - 

Iff; 

4'* 

4*5 

511  C0*I lKUl 

i*p*. 

6te 

H»* 

!T*1 

411 

CO  *1?  IM.HV 

TPM 

617 

If  IfYALOf  tl»  .tO.C.I  SUHAUMJ. 

TPM 

611 

!*■  l^llli.kE.g.) 

TPP1 

614 

47* 

4i?  continue  -  - - 

»PPX 

615 

HH* H*1 

TPPl 

6t€ 

CO  611  1-l.PH 

tpp: 

417 

611  if  if «*iuci:> .eo.fviiLC $un«i*i  >«-sjha  ti»ti 

TPP 1 

41* 

65?  I*  IH.Hf.4fl  Hf«H 

TPP1 

615 

*75 

00  *51  J«1,HV 

tPPl 

67C 

451  fT»Ltf  U»*5UH*fj»  - - — 

TPPJ 

471 

CO  TC  545 

TPPl 

677 

7C9  CONTIH-JE 

TPPl 

6>S 

CALL  MAH  (C.Hf.l! 

TPPl 

&'  4 

oc 

CALL  f *AH| SW*'8 «HVV«“H8*1 

TPPl 

425 

CALL  MAH  iSUHA.Hf.-HMI 

TPPl 

676 

— 

If  IJCCHV.Hf.Tt  CO  TC  Ml -  — 

TPPl 

477 

:  JCOHV*?  IHSCHT  Afll  H  ACT  *C0yiPC*£HT 

TPPl 

6?* 

00  731  X«1,*V 

TP*1 

676 

4*5 

7,;  :r  fSUHAIII.CQ.  Cl  <• I 

TPPl 

tie 

CO  7*5  1*1. Hff 

TPPl 

Oil 

C»0  715  J«I.< 

TPPl 

41? 

- —  -  - 

re*  ir<$L**4(ji.£«.5t>*«t! —  - - 

•PPJ 

6  S3 

00  712  I«l,«t 

T*»P1 

414 

*11 

75?  f VALUE  111 "SUHA 111 

TPPl 

634 

TPPl 

616 

00  713  1*1 «  WVV 

TPPl 

637 

7*1  f VALUE! I«K>*SUH4«:i 

?pp; 

*38 

■  «■—  —  —  - 

HT»«HT*HTf - - - - - - - - 

?pp» 

634 

4*5 

<1»<»1 

TPPl 

6*8 

00  71*  I-1.P55 

TPPl 

641 

00  71*  J*K1«MV 

TP*; 

642 

7*4  If  If VALUE  1 II  •CQ.JyHA  t J)  .  SVHAIJI-t. 

TPPl 

643 

00  764  I*Hl*Nf 

TPPl 

6*4 

00  717  X*l*HVT 

TP*1 

*4* 

If  XFVUUCD.EQ.i.l  CO  70  Mi 

TPPl 

6*7 

CO  TC  7*7 

TPPl 

64  e 

~ 

MJ  00  711  J«!*HVT 

TP*  1 

645 

5*5 

711  FVALUE! Jl »FVALUC ! J*l> 

TPPl 

66 t 

*•» 

TPPl 

65? 

-  — 

CO  715  I«1«|TTT 

TP*1 

653 

715  IF  frVALUCfXI.HC.t.J  H*n»i 

TPPl 

654 

Ji: 

mr»n  -  -  •  -  — 

TPPl 

*55 

CO  TO  5*5 

TPPl 

*56 

C  JCOHV»*  IH5CHT  iCfOHC  *£T  «QUI4£H£HT 
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551 

1*5  0 

•  21 

5*6 

552 

2*.  3 

•23 

**r 

5*7 

566 

631 

1*53 

•25 

569 

5*6 

0 

1929 

026 

*79 

575 

577 

32* 

5*9 

597 

■v>«  — - 

-39* 

*29 

601 

595 

1570 

•32 

63* 

599 

0 

435 

607 

606 

0 

4*9 

573 

572 

501 

9$r 

0 

0*2 

563 

5*5 

1523 

•*3 

5  •» 

5*0 

Ull 

4*5 

610 

573 

2*1* 

•*6 

*1T 

6i: 

61v 

uu 

050 

613 

5*7 

iu?- 

031 

*26 

*19 - 

*29  — - - 

"621-  -  —  62*  — 

0 

052 

624 

627 

0 

•  55 

617 

616 

16Sl 

•56 

631 

617 

1*63 

•  74 

633 

5*0 

6 

•  76 

637 

636 

■922*- 

0 

•7« 

fc-l 

6*. 

IT19 

•95 

6** 

637 

7*J0 

•96 

6*5 

6** 

20*1 

900 

**t 

191 

147 

20  *7 

9<.  1 

•**r 

193 

192 

-  *«*" 

■9 32  -  - 

195 

;9-  -  - 

-- - 

- - -  -  _  _ 

2075 

90* 

rMt 

190 

197 

139 

—Ml* 

90S 

205 

20* 

2125 

907 

*■*7 

210 

209 

‘  21*1 

9|« 

'HT 

2 15 

21* 

2156 

910 

f*T 
*9f  ■ 

23* 

233 

( 

^  U  U  '•  O  N  > 
U  VI  *  I'MW' 

«1. 

9'.5 

f.i0 

92t 

921 

9  It  - 

-  —167  — 

165 

172 

175 

315 

369 

-  2*3-  “ 

'  165 - —  — 

166 

171 

17* 

315 

36* 

2** 

f*I 

*9t 

r9f 

*1t 

*■*1 

f*f 

221*. 

932 

fur 

2*9 

2*0 

— 22*  J' 

933 

fir 

279 

27» 

-  - 

21  «6 

93* 

■ir 

273 

272 

— 2W5- 

•9*0  - 

-r*t- 

300 

299 

- 

—  - 

7170  3*1 

— 2*22—9*2 — 

2J6*»  950 

flT 

2*1 

2*0 

fit 

*23 

-““291 - 

*22 
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TABLE  C-l.  (Continued) 


SU940OT1NE  INPUT 

lUTC^NI  »A0CtS 
23 *r  *>i  rir 
— 23M--652-  — *NT 
0  1000 
t  i*:o 
700  1050 


7 9/7*  OPT«t  T»4C€ 

OEf  LINE  9£f£9ENCCS 
All  *10 

379—  -379- - 

9»  M2 

92.  *19 

*.09  *67 


LOOPS 

149  Cl 

t*«0£  * 

tkon-io 

length 

PROPERTIES 

3 

19*  151 

- 99 

- 1  _ 

_ . _ 

11 

•  J 

152  155 

199 

NOT 

26 

I 

169  155 

29 

INSTAC*  — 

15 

•  < 

157  H2 

169 

NOT 

15 

J 

161  162 

38 

INSTICK 

207 

63 

*  J 

23l  236 

*<•  B 

-502 

-J  - 

25*  256 

—39  — 

- - i*ST*C* - 

510 

•  J 

26*  265 

308 

•  J 

291  261 

109 

512 

J 

296  297 

98 

INST«CK 

5l5 

J 

336  3*9 

36 

J 

326  331 

93 

INSTACK 

953 

513 

♦  . 

33*  336 

79 

530 

•  < 

397  35J 

179 

•  J 

3*6  a>0 

78 

INSTACK  Ei 

555 

♦  I 

3j9  366 

68 

INST7CK  EXITS  — 

- 555- 

696 

-5%r  — 

I 

-p“t - 

373  379 
^379-377-  ■ 

39 

- 179 — 

INSTACK 

-91 3 
632 
-9%  9 
65* 


M 

553 

-550 

552 


IWt  912 - 

1053  511 


1117  701 

—  1175-  795- 
1131  705 


375  377 
302  300 

390  391 
393  *00 
397  399 
-912  913— 


fJj  — 
33 


717  1010 

J 

919  920 

- 733  - 

922  *22 

75l  601 

I 

929  926 

- 739  -695  — 

-♦  j 

633  993 

766  605 
- 199*— 693— 

J 

935  993 

1116  632 

I 

953  951 

- 1629-619 

955  965 

1033  610 

J 

957  965 

IMSTACK 

- OPT 

INSTACK 

INSTACK 
—9 ♦♦STACK 


-£XT  +£*Z - -  - 


- 1193- 

1155 

792  —  I 

70S  X 

- - - 965  99t 

992  993 

1172 
— 1297 
1213 
— 1229 
1233 
— 1295- 

706  J 

719  I 

707  •  I 

997  998 
“  '  “999  50t 

501  506 

715  I 

■  751- - H 

506  595“ 
509  509 

1255 

755  •  I 

517  519 

I  ft*  TICK 
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TABLE  C— 1.  (Continued) 


SU3R0UT  IN£  INf>UT 

74/74 

OPT  =  l  TPACE  FTN  4.6.439  04/08/80  15. 

LOOPS 

LABEL 

*HQit 

-R0M-T3 

LENGTH 

PROPEffTIES 

1261 

/55 

J 

516  519 

43 

IUSTACn* 

/52 

520  521 

nos 

/53 

I 

523  524 

2B 

INSTACK 

1313 

756 

•  i 

526  528 

168 

not  inner 

1331 

/56 

J 

52/  528 

49 

INSTACK 

1336 

/54 

I 

529  530 

29 

INSTACK 

1342 

757 

*  r 

531  535 

140 

NOT  INNER 

134  Z 

761 

■j 

534  535 

30 

I  NS  TAG*-— - - —  -  -  -  — - 

1362 

Z65 

i 

538  5  33 

%3 

INSTACK 

mo  7 

820 

•  i 

551  552 

53 

INSTACK  EXITS 

1415 

601 

*  i 

554  561 

223 

NOT  INNER 

11.2  3 

802 

j 

555  560 

10B 

OPT 

1442 

8j  3 

i 

562  563 

33 

INSTACK 

1454 

6«0 

*  i 

572  573 

53 

INSTACK - EX  MS - - - -  -  —  -  --  - 

1463 

626 

*  i 

5/5  5/9 

179 

NOT  INNER 

1471 

626 

j 

577  579 

59 

instack 

1506 

«4  2 

•  i 

583  587 

1/3 

NOT  INNER 

1514 

642 

j 

585  587 

59 

INSTACK 

152/ 

627 

•  i 

590  605 

518 

NOT  INNER 

1531 

627 

*  j 

592  605 

458 

-  NOT -INNER - - -  - 

1541 

626 

*  < 

59/  599 

179 

OPT  EXITS 

1603 

835 

i 

606  607 

33 

INSTACK 

1615 

355 

*  i 

616  617 

50 

INSTACK  EXITS 

1623 

C51 

•  i 

619  626 

243 

NOT  INNER 

1631 

651 

j 

620  626 

123 

OPT 

165c 

852 

i 

627  628 

38 

INS  TACK - - -  - —  -  - 

1664 

676 

•  i 

636  637 

59 

INSTACK  EXITS 

16/4 

877 

i 

638  639 

29 

INSTACK 

1702 

676 

i 

640  641 

38 

instack 

COMMON 

BLOCKS 

LENGTH 

COATA 

21306 

- 

— 

— —  -  - - - -  -  —  - - -  - 

IOO 

14 

NEL“ 

BOS 

/  / 

1C2‘I 

WORK 

10500 

STATISTICS 

-  -  - -  -  -  -  - 

PROGRAM  LENGTH 

33238 

1747 

C«  lAQlLED 

C0130.I  LENGTH 

ZZZ268 

32726 

- 

CH  3LAN<  COMMON  LENGTH 

237 32B 

10202 
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TABLE  C-l.  (Continued) 


svprouthe  MC9 


/%/?•  OPT-1  TRACE 


FT* 


3WM/AA  15« 3A.lt 


CONFUTE  fRCOUENCT  «1TR|«  FO*  EACH  SUP-LIST 


5 

5 

- 

.1 

: 

15 

: 

: 

- 

?5 

- 

SO 

= 

— 

J> 

:: 

— 

** 

—  • 

— 

*5 

— 

55 

SUBROUTINE  FREQ 

CONHCN  /COAT*/  hll  «nJ«N*T»  NA*€ t ?.J08) . A ( 1 «l. I 191 . Ml I J Cl » . * J< 15 1> 
•  •  •***£  UJH  «N$I2€  <  t#t*«  JSOtt  4  lH*  ill) 

CO**NCN/:00/*£AOER<ll  ,M}TCCn.NPTtP1.JPTtP?.*Fu2.NPRInT«JTIC 
-Ca**CN-/*OOK/«TWt,*4**,COPP4T4***>*4***TM*WP4tfFT444*-  — - - 

:oimck/  /n atr,  TMLOtSCmteei  ,c$*utt»m> 

OAT  A  KO*S«/~— - •/ 

DATA  HOT /*"  *“/«  NCO/"  »*/ 

00  ACC  K  »  1.HJ 

N*  -  MUEKt' - - 

JUDGE  •  JNANtCKI 

00  502  J*X«Nb< 

53?  /RANK  I  J)  •  * -  - 

00  510  JMtNV — - - — - - -  -  — - - 

!  ■  JSUBCCJ.KJ 

i  '  xAssm 

JRANK«.*t  •  L 
JOREftJI  NCT 
IF«  I  .U.  {  » 

51 1  CONTINUE - - - — - - 

JP*£F<1)  •  “  * 

500-LIST  FREOUEnCt  NATRl* 

CALL  *AT«>I*  <N«R,Nv,  JUDGE, /RANK, JMtMH 


JPREFTJI  »  NEO 


—  NCICNT-fftCOoCRCf  HAT«I«- 
IF  IKATR.Ca.ei  CO  TO  5SP 

slt  evaluation  weighting 
00  515 

00  515  J*t»N4R 
-  -IF-4N»T.€5|. 

515  *C, J»-K(I,JMESRCI.K» 

IF  <NPR!NT.£0.?.OR.N»AlNT,E9,«,ON.*»5X«r«£0.5»  CO  TO  $«• 

WRITE  (6,930)  HEACER, JUCGC.  CJP*CF  U) ,  J»ANK  (  J»  .  J«l,  NWI 
5««  F0RHATC-1SO5-LIST  SELF  CnALWTIO*  FO«9U£*<;»-«ATRI*-,10*,4A1#,//1*, 
•AtS»IT12,2«UTt:i>/)l 

- |F  4M?AiCCifl  NP1TC 

511  FORNAT  (/“  REOUCEC  NAt*lX-/l 

WRITE  <1.901*  <diT»l.*«R» - 

501  FORNAT  </~  PROJ-, U7.20I6I) 

WRITE  IMITf  -mMftffWiMTt-  - 
5J2  FORRAT  <lX.T7,234tl 

— - W“»M»t>KW - - - 

503  WRITE  (6.95AJ  l »  C !C (X  .  J) »  J*1»NSR> 

IfN-fORwAT  «lXt!3«RTA«-I^*SE0F*«*n-- 
510  CONTINUE 


FUNCTIONAL  WCICHtlNG 
-CAvtNEICNT  -RNWT^NBRyi 


TP#x 

-JP»l- 
TFP1 
fP*l 
TPPt 
TPP. 
TPPl 
TP»t 
TPPl 
TP*  1 
TPPl 
TPPt 
TPPl 
*PP»  - 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
»PP». 
TPPl 
TP»t 
tPPj 
TPPl 
TPPl 
»PP»- 
TPPl 
TPPl 
TPPl 
TPPl 
TPPl 
TPP1- 
TPP! 
TPPl 
TPPl 
TPPl 
TPPl 

-W|- 

TPPl 

TPPl 

TPPl 

TPPl 

TPPl 

-TPPl - 

TPPl 

TPPl 

TPPl 

TPPl 

TPPl 

-TPPt-- 

TPPl 

TPPl 

TPPl 

TPPl 

TPPl 

-TPPt-  ■ 
TPPl 
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TABLE  C-l.  (Continued) 


3U9R0UTt*l!  FR£3 


74F74  CPT»1  TRACE 


FT* 


94/94/49  15*39.  36 


SUN  SUB-LIST 
-00  92fr-J»  1|N0R- 


TPPl 


00  520  I  -  1«M8R 

5?o 


bOO  CONTINUE 


RETURN 

CNO 


TPPl 

root 

TPPl 

TPPl 

TPPl 

-IP*t- 

TPP1 

TPPl 


455 

956“ 

957 

•59 

459 

-664- 

957 


STN90LIC  REFERENCE  NAP  IR*2) 


ENTRY  ♦0IN5S 
1  FREJ 


VARIABLES 


Off  LINE 
3 


REFERENCES 

66 


1133 

166 

0 

311 

A 

ESR 

NEAOCR 

I 

REAL 

teal 

real 

INTEGER 

array 

ARRAY 

ARRAY 

COATA 
✓  / 

100 

REFS 

REFS 

REFS 

REFS 

5 

9 

7 

22 

61 

39 

41 

25 

OCFIHEO 

2*31 

61 

3*39 

2*51 

3*61 

- 

■*-  define  0  ■ " 

tl 

36‘ 

-  ■"  69 

310 

J 

INTEGER 

REFS 

19 

21 

23 

24 

25 

2*39 

2*39 

-  — 

- 

2*41 

-  -46 

51- 

3*61 

OEFINEO 

17 

25 

37- 

41 

46 

49 

51 

59 

*9374 

JNANC 

INTEGER 

ARRAY 

COATA 

-  —  REFS 

-5  - 

-- 

- 56 - 

— 

— — 

2424b 

JFRCF 

INTEGER 

ARRAY 

WORK 

REFS 

9 

39 

41 

OEFINEO 

24 

25 

27 

*4974“ 

25706 

JRANR 

JSU6L 

INTEGER 

ARRAY 

COATA 

REFS 

5 

-30 

21 

41 

-StFIWfS 

16 

-15-  -OttE 
3. 7  .'UOC£ 


0  NATR 
“3  NAN* 

0  NBR 

211  NOASh 
-tTS — Nttf — 


INTEGER 

INTEGER 

INTEGER 


INTEGER - - - 

INTEGER  /  / 

INTEGER  ARRAY  coata 

INTEGER  COATA 

INTEGER 

-INTEGER - 


13  NFUZ 
— 2l?-NGr  - 
1  NJ 

“IT — NOTCON 
16  NPRINT 

- tt - NFTTPt 

12  NPTVP2 
*5$« — NSm  “ 
306  NV 
- 2  -WNT - 


INTEGER 

INTEGER 

INTEGER 

"INTEGER- 

INTEGER 

-tNteOER’ 


100 

COATA 

-too — 

100 

-too — - 


REFS  - 
REFS 
'REFS  - 
DEFINED 

- REFS - 

REFS 
REFS  - 
REFS 

- 50 - 

REFS 

- REFS - 

REFS 
REFS-  - 
REFS 

-REFS— 

REFS 


30 

16- 

13 

— -E3— 
9 

5 

_5t- 

49 

7 


41  OEFZNEO 
-15* - 21 


15 

39 


17 

- 91 — 

DEFINED 

-OEftNCO- 


31 

10 


36 

-59- 


INTECER  100  refs 

-INTEGER - ARRAY  — COATA - * — REFS- 

INTEGER  REFS 

— INTEGER - - - COATA—  -REFS- 

REAL  ARRAY  /  /  REFS 


30 

— Of— 


DEFINED 
- 56 — 


2  SEN 


9 


'i.'.IM1’  . 


TABLE  C-l.  (Continued) 


-$VW#VTI*«£  f*£0 


-  - ©*?•■  -IMGt- 


TABLE  C— 1.  (Continued) 


ioewtiTut  «t*x* 


7fc/7n  o* t»;  T*ict 


f«CQoC«Cr  mat«Ii  ?or  u-*  $>j*-txst 

SUSRCUTIMC  »UTPXt 

HtTPC  •  8  TC  COmSIGER  CAm<C3  fARIAnC $  0*>tr 

*  j  io  cowsiot#  au  uxti^co  vttxAnes  €cu#t. 

**■*  •  lorAt  Munect  Of  VAPXA9US  In  Sluo*. 

JVXe  -  **nt  Of-5u«-tl5|, - - -  _ - - 

JtAMC  ■  PROJECTS  Rl*t«EO  I*  0R3ER  Cf  *>«ff ?tC*CE. 

A»tEf  »  rt£fincncc  or  »»mxo  projects  t  *  .  •  ». 

*  •  fRcarCMC*  matri*  for  sui-ust. 

«¥  -  MURK*  Of  t«w<eo  In  SyR-tlST. 

CO*n0«/I00f4CA0fR«*»  *  nolens  wp  »  ?  tpp, «*  u»  ***«  f  **  §>f  if 

3IN(HSIflH  HlXXiltXI  «  J»lti«ctec>  •  Jf  »Ef  II  8tt 

OIMEKSXC*.  JR  ( t  If  I «  JMXJII 

mi*  ntir  »“/,  «ar  »*■/ 
oaia  Kiiinr— — "/ 

5£t€CT  1Y*£  or  c*tctn.*Tto* - - - - - - __ 

EQ«At«e.$ 

AQVUU.f 

If  (KriTfl.CQ.fi  I  CC  TO  s 

EQTAL«f.l 

AOfAl.fi. C 

'9-confrwt  —  - - - -  - _ 


nti  ■  hi 

oo  t«  j.i.nyv 

jttjt  m  jftmcui 
13  .TCJI  •  JPRCf I  Jl 
tt>  it  j  •  tint*  - 
00  17  I  ■  I, MIR 
17  MI.JI  ■  l.l 
MtpKii*: 

00  If  K»l«Mfttl 
1  *  Mill 
i.*  - 


If  (jr«K*tl.EQ.MEQt  XK.EQTH 
n  m  K  ♦  1 
00  *6  M.n.nrr 
j  *  jsin 

MI«J1  •  IX 

“*-*«»  -  — - - - 

XF{  J* (H*il  .ME.  MCQ  >  ||  > 

*3  C0nTlirtJ£ 

>3  CONTINUE 

if  (w*n.iQ,ii  irui*i 
‘  Tf  IMfRIMT.OCrl.AMO.wmMmCsOl— 1 
00  14.  I«X.MCR 

00  IK  JTl.hM  - - — , 

If  (MriTM.CQ.I.AM9.IIX.J».EQ..9l  JTXE-I 
if  tnmrt.to.i.iMO.iit,j|.to.t.t-^mt*t= 

1*  COMTlMUC 

-■Wtttrtttf - Mettetv-JoWEr- 


95?  fORMAtl-lSOt-UST  fREOOEMCr  N*TRtT%tf  i^mIi/^ 


e*/u/»e 

IT.II.J 

Wl 

«♦* 

tr»x 

*ii 

tppi 

5*1 

tppx 

•  47 

tppi 

tpm 

It' 

XP*l 

TP# 

TP*1 

•  M 

Tff  1 

57? 

Tffl 

*73 

•  7k 

tppi 

*75 

»m- 

-*M- 

1>7  1 

•  77 

TPM 

•  70 

TPM 

•  7. 

tppi 

*51 

tppi 

•  PI 

-  tppi 

**?— 

TPPJ 

•*5 

Tffj 

IS 

TPM 

f«5 

TPPl 

m 

Iff  1 

•  •7 

»r#l- 

HI 

TPPi 

•  ** 

TPfl 

HI 

TPPl 

•  *1 

TPPl 

5*7 

TPM 

•53 

-  TPM  — 

•** 

TPP 1 

*15 

TPPl 

•H 

TPPl 

•  *7 

TPM 

•  *« 

TPM 

•  91 

TPM  *  - 

-  TM 

TPP1 

*:i 

TPM 

*5? 

TPPl 

Ill 

TPM 

*c* 

TPPl 

*:s 

TPPl 

— -*t*-  — 
117 

TPPl 

lit 

TPPl 

*19 

TPPl 

*ie 

TPPl 

*i  * 

TPPl 

m? 

TPPl 

*13 

TPPl 

*1* 

TPPl 

*1? 

TPPl 

*U 

TPPl 

*17 

-TPPl-  — 

TH-- 

S  TPPl 

*1* 

144 


•  tvrtCK 

’»<■  < - - !«f€«C«- 

«•  *  MtEC» 

-HE  » - MKIt- 

•  KM  XNTSCCK 


Si  OCFX«CO  3 

-*9 - —  M  — 

*2  45  D£ft«UO 


FILE  NAMES 


- ST*t€*£**T~t*BEtS- 

22  S 


TCS - ?«- - - -59 - 


oer-ttue  nefenences 


92  12 

"52 — BO- 
37  *0 


f  ROM-Tfr" 
29  31 

32  39 

33  39 
36  97 
91  96 


INSTACK 

—  NOT  INNEN 

INSTACK 

- NOT-  INKE5- 

OPT 


CM  LABELED  COMMON  length 


160 


19 


TABLE  C-l.  (Continued) 


StfWUT**£ 


0*T»1  14*C* 


#?*» 


o o  *?r  j  •  i.a»4 
oe  474-t  ♦  t««*4* 
lfl  Mi.J)  .It.  3.6  » 


CO  10  *?■ 

*d,il  «  «ii  *  t  * ts.it  ♦♦  «t(l*  * 
573  CO*Tl«wC 
60  TO  9*3 


w  r«  - - - 

00  7*3  X  »  1.644 

«M  *d.i.  .CQ.  8.3  I  CO  to  r?s 

fd.ii  ■  xtl.ii  »>Zdi  *  «ii 

•73  C09TX«VC 

co  to  93: 


*35  DO  *25  j  •  I.ut 

co  itt  i  i.»»** 

IF  I  Id.i)  *U.  :  I  03  TO  m 
Xd.J*  •  4L06C  fldl  ♦  «ii  •  Ktl.JI  t 
?7:  CotM *eA 

F#X«iT  «{IWt3  -mix 
comti kuc 

If  <M>*:6T. £0.7.04.9*4:61. f0.6.O».***X«iT.E0.St  4£l649 
«»iTt  »•*:;>  «f43»»,jwi£.ij.i»:.irt») 

»?  fO»H*7 «///”!•»£ IC*U3  SU9-t!ST  r*tCOCiCf  urtlf ‘.Stf.Mlt// 

•M.iti*//*  —  -  — - -  — 

H*:uiti*e$i  i  6oa$m.  jii.ftt  i 
*.?  !s»«ni:i,Tt,;jnt 
00  978  1*1.N» 

■tITIitittti  t.  t  xtl.it.  i»i.»rt*  i 
330  70*9* T  dX.X3.tT6.-I  '.IJft.lJl 

9_*4CO**l«Ot  -  - - - -  -  - 

•fluff 

C«D 


li/tt/tl  IMI.H 


19* 

447 

9*3 

996 
995 
999 

997 
499 
«99 

tilt 

1333 

in; 

tecs 

*996 

1335 

i:lv 

it*- 

XtJ4 

1C39 

«« 

icti 

!SU 

15X5 

15.6 

1315 

1914 

1317 

ltt« 

1519 

137* 

1*71 

1*77 

1375 

1376 


5Tf»9li:  14*71 


txlfrr  *ot**rs 
5  9fJC«T 


fX*X*Sw.‘S 

5  94*514 
*1«  Z 


t  i9*4l 
■  19  iTJt 


i  TT»£ 
JftfSff 


15 


4n.0C*TXO9 
*44*T  :S3 


f.f. 
t»  — 
f.l. 


*f#5 

ffrs 


4CFS 

53 


51 

•ffs 


7*71 

r*r 

3*75 
—5?  — 
7*71 
7*54 
57 
59- 
•1 

--It— 


Of*  X9C0 
45 

0£rifc£D 


7*79 
3*5% 
0»rj6£t 
—  44 

2*35 
7*91 
7t 


7  * 
34 
67 
77 

91 


5*41 

;« 

*t 

7**3 

it 

*6 


>•67 

7*75 
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TABLE  C-l.  (Continued) 


<!  *C(4**I 

-  f*»UK(5  5**  »•« 


—  -  3*4 

*04  S'* 

I«rc«C* 

13 

HfjZ 

Ht«£s 

1* 

*oi to* 

I4»C4£« 

1* 

4**I"» 

IZ 

**t*>z 

I5*J5C* 

* 

X*T'«£C 

e 

MI 

««• 

•II 

*U4 

K/N  5*l»l  ia*« 


135 

ICO 

ICO 

133 

*.r. 


«»4  4.**»t4 


*SU 


*ttt  «**•* 


«03€ 

-4T 

Tt»£ 


1* 

45 

♦5- 

- 7^ — 

-  ~>1 

3£«JmCC 

J 

•i*S 

44 

»{fl 

s: 

it 

*IfS 

«(»t _ _ 

ts 

IMS 

H'% 

~~  H 

*£7S 

?*1S 

zs 

-in 

IZ 

z* 

«• 

7< 

CtMKO 

ccrs 

» 

-3 

- - 

- 14- - 04*14*3 

*££5 

33 

47 

o£*i**r 

t€ 

»£f  S 

IZ 

zx 

*7 

5  J 

5* 

75 

*7 

3'tXfcCO 

- 4»— 

— 5*- 

- *1  - 

41 

4. 

•7 

51 

41- 


SWM/II 

5? 


3€CI»K0 

3* 

I 

—  -  1-, 


StMWMtfKw 

.  5i 

-5f-t#4 - 

c  izj 


litCS  4ff  £#C«CC5 

*H#Wf  — 


?* 

Z* 

»  - 


«€f €<(«C£S 
15 

Z5 


Z7 


Sf 


Zl 

^5 


o3 

4# 

33 


C  778 
- -isz  »t 

174  3Zt 

- IIZ--4H 

1*7  *71 

33 

3* 

41 

4* 

31 

73 

34 

71 

44 

IZ 

34 

45 

14 

44 

XM  5ZI 

5? 

Si 

SZ 

S3 

• - *77—4**  - 

5* 

73 

ZX4  «zt 

*7 

54 

44 

4* 

■  >  (ft-fll - 

*5 

2J  -- 

■ — - 

— 

234  723 

44 

45 

*4 

<7 

•2 

*5 

•5 


"  —  *V 

14  Zl  14» 

tt  n  »  - 

W  Z«  5*1 

i?-»  - M — 

St  IS  1*1 


149 


T/FL.E  C-l.  (Continued) 


SU8R0UTI  l£  HEIGHT  74/74  0PT=1  TRACE 


LOOPS 

LABEL 

IMOEX 

100 

220 

I 

- no — 320 — 

I-  — 

113 

320 

J 

133 

**20 

J 

134 

420 

I 

156 

520 

J 

15  7 

520 

I 

-  208 

620 

J 

201 

620 

I 

2?  2 

7»n 

J 

231 

720 

I 

2<*2 

820 

J 

243 

82; 

I 

272 

J 

302 

J 

310 

920 

I 

313 

J 

COMMON 

BLOCKS 

LENGTH 

— 

100 

-  14 

FROM-TO 

LENGTH 

32  33 

36 

—  36~4t-  -  - 

—  21B 

38  41 

14B 

44  h6 

218 

45  48 

!69 

51  55 

208 

52  55 

155 

SO  62  — 

~—2l& 

59  62 

16B 

65  69 

169 

66  69 

48 

72  76 

209 

73  76 

153 

ei  6i- - 

-43 

84  64 

43 

86  89 

206 

87  87 

118 

PROPERTIES 

INSTACX 

-  EKT-^ePS 

EXT  PEFS 
EXT  REFS 
EXT  REFS 
EXT  REFS 
EXT  REFS 

- -  EXT  REFS 

EXT  REFS 
NOT  INNER 

INSTACK 

EXT  REFS 
EXT  REFS 

- EXT-  REF-5- 

EXT  PEFS 
EXT  REFS 
EXT  REFS 


FTN  4.6t-439 

NOT  INNER  -  — 
NOT  INNER 
NOT  INNER 
NOT- INNER  - 

NOT  INNER 

NOT  INNER 


STATISTICS 

PROGRAM  LENGTH 
■CN-tASELEO  COMMON  LENGTH 


5136 

166 


331 

14 


fl 


TABLE  C- 1.  (Continued) 


5W<0JI|'*:  040*4 


,  PP*NT  4A*C  C*0C* 

SUSRCOHNE  04JUI  h*m£  ,  S8»  .  Su«A  > 

COfi «*Cfc 'tin* /t  IS1C«130. 3*  »t!SI  I199>« 

CONNCT./XCO/MtiOE*’  «*l  ,*»CStC04.«*Mpl  ,..PT?*2fNfu7,»<*RlNT,  JTIt 
0INE6SICN  SUNAl  1  I 

0I*«£4SIO4  USAN<«i44»*^P«f*4**:*— ' — — - - —  -  - 

C  ‘..OPT  SUN* 

00  2C0  J»S.n8R 
J*>t F(A» -•  *  ►“ 

2S3  J4ANK(J>  »  J 

- U*4€  *«»-•-*—• - — - - - - - 

oo  fit  J-i*we<i 
oo  <r.«j 

J fi  $U4AfJ»  .6V»-5t*»A«*l  »  60  TO  ft# 

1CHP  »  SUNAfJI 

—  -  j*  —  - - - — — - 

$UN4(JI  -  SUNAIXI 
JOWKIJI  •  JAANTJO 
SUNAIXI  «  T £Nr 
J4ANM4I  •  J* 

2X  J  CONTINUE _ _ 

IF  CNP4:hT.£0.5.ANO.MME.NE.-P«EF**I  4£>0RH 
IF*  HA*T  “  “  »  4CTU4N- 

c  STORE  FOR  CCNC090ANCE 
If  «NA«E.£Q.'f02Zf» 

IF  (J1I£.CQ.1'An0.NAH£.£0.~A9J~>  L  ANI  X  I »NA*E 

—  -  — JF-T  J»IE.t0i9»4**O**A*f.*«.-,<lO«W4-V*64f*4*A*€ - 

.»$  J*1 »N84 

tiST  (J)»J4At»M  J» - - —  - 

215  CONTINUE 

00  2lfe  ^»2.N*4  -  -  -  '  -  -  — 

218  IF  <SU*A<J».ea.SUKAU-in  USMj|*-USTIJ» 

- 00-2tM*»,«OR - - 

If  1 JT1£*£Q»1*  ANO.NAHl  .EO.”BO*OA“)  CO  TO  21? 

If  UTIC.EO.O.AW.HiWE.fO.-OOOOA’F  4.ICTC4 I*I»«IISHI»- 
If  <  JTIE.EQ.1.AN3.NANE  F9.**A0<D  USTC  (1.  IT *1X51*11 

—  - If  -Tj»IC.E0.».ANO.NAN€,^0«~*Or*»“6«  ^O  21  f— - -  - 

If  TMHE.EQ.-PREF-l  U$TC  <  I,2>  *U5T  IIJ 


21?  CONTINUE 

- If -<H*4INT«E««5»-«£ft>*N- - * — - - * - — 

00  220  J*2«NeR 

?ft- IPT  SUrtA  UT-*€0*-3ONRt^-t»-  ♦  J*4£Ft  J»***»-  —  - 

If  (NAHE.EQ.a>AOjMt  NA"1£»"A0J  80R0A" 


996  F0RNAT(//1XA10»  (Tl2,24(A2,IS» //I  > 

—  -*4!TE(*i991» - - — - - — - - 

95  S  FORMAT (1X1  _ 


/99/AA 

15.TA.T4 

Te*«»: 

.(« 

1 

192* 

1**1 

132? 

TP«>1 

13?A 

t*Pi 

• ;  ;r 

TP*l 

15 '9 

T*Pl 

10U 

l**l 

19+t 

TPP 1 

1331 

»**t 

1934 

r**i 

1C  34 

i**i 

19  16 

T**l 

195? 

»PPl 

-199* 

TP*  1 

1934 

frpl 

1940 

ipr  i 

1  C  4  1 

T  *P  1 

1942 

TP*) 

1043 

•  **1 

1944 

TPP1 

1045 

T**l 

1 C  46 

TPPl 

104  • 

t*Pl 

iO‘*e 

T*P1 

IV  9 

»*#1 

3  9*9 

T**I 

1851 

1**1 

1952 

TP*  1 

tOM 

TP*  1 

1954 

»**l 

1055 

-  195V 

I**) 

108? 

T**t 

1054 

T*<*1 

1059 

T***l 

1969 

’**1 

'.961 

--***!- 

- ( 6*2 - 

TP*  1 

1063 

*  *1 

1964 

T**t 

1965 

T**l 

1969 

TfPl 

106? 

T**l 

1069 

T*P  1 

lt?9 

T**l 

10?t 

T**l 

It?  2 

|CT| 

10?J 

T**l 

1075 

TP*l 

19?* 

TF*1 

tt?7 

T**l- 

-19?9 

T**I 

10?J _ 

T  P*  1 

1641 

151 


TABLE  C-l.  (Continued) 


SUBROUTINE  ORDER 

76/7*. 

ORT»t  TRACE 

«TN  6.6*639 

•  6/01/11 

15.31.16 

' VH90L 1 

C  R£F:REnC£ 

NAP  (R«2> 

entry 

»0INTS 

OZ*  LINE 

RETERENCES 

3 

0*01* 

3 

2/ 

26 

66 

56 

VARIABLES 

st  r*  i 

RELOCATION 

0 

HtO£R 

real 

ARRAY 

100 

REr  S 

5 

- ti>v 

1 

INTEGER 

•CFS 

?**♦ 

2*61 

2**1- 

2*6% 

OFFINE0 

14 

2*6 

J 

INTEGER 

REFS 

12 

2*13 

17 

:• 

11 

23 

22 

2*?6 

•*37 

3*66 

2*59 

OEFINEO 

tl 

33 

J6 

67 

59 

nr 

JR 

INTEGER 

REFS 

’A 

Of FT*<  0 

20 

Wi 

JRREF 

I*T£r»CR 

ARRAY 

REFS 

3 

50 

OEFINEO 

12 

16 

6  9 

- i*t~  /ray* 

INTEGER 

ARRAT 

RtM 

* 

2f 

22 

)6 

5? 

OiFXSEO 

13 

22 

26 

13 

jtie 

INTEGER 

IOO 

REFS 

5 

31 

32 

3- 

60 

61 

255 

< 

INTEGER 

*EFj 

13 

21 

22 

23 

26 

DEFINED 

17 

62. 

L*9 

INTEGER 

ARRAY 

RANK 

REFS 

6 

OEFINEO 

30 

31 

32 

—  65* 

-tttt 

INTEGER 

ARRAY 

RANK 

♦EfS 

> 

32- 

*6t 

61 

69 

66 

DCFINCC 

Tfc 

37 

0 

USTC 

INTEGER 

ARRA* 

RANK 

REFS 

0 

OfFINEU 

60 

61 

63 

66 

Hk*£ 

INTEGER 

F.P. 

•EFS 

27 

2# 

2*33 

2*31 

2*32 

39 

61 

6? 

63 

66 

69 

5 ; 

56 

CEfineo 

J 

61 

56 

—  ■  •“  j 

HO* 

INTCGER 

f  ,P. 

REFS 

- lt 

---—Ml 

If 

31 

3E 

M 

52 

OEFINEO 

3 

13 

nrui 

INTEGER 

IOO 

REFS 

5 

xo 

notion 

integer 

IOD 

REFS 

5 

16 

NRRINT 

INTEGER 

100 

REFS 

5 

27 

66 

11 

NPTYP1 

INTEGER 

too 

REFS 

5 

- :t  HPTYRt 

INTEGER 

IOO 

REFS  - 

— _ —  t, - 

- - - 

-  - — 

- 

- 

0 

SUNA 

RE.-'. 

ARRAY 

r.p. 

REFS 

7 

2*l« 

19 

2x 

2*37 

2*63 

- — 

OEFINEO 

3 

21 

23 

231 

T£HP 

®EAL 

REFS 

23 

OEFINEO 

19 

riu  names 

NODE 

*Nf 

«.**€*- 

** 

32 

—  sf*rt»«fAi  labels 

OEF  LINE  REFERENCES 

-  - 

• 

200 

13 

11 

- *3 

nt 

25 

16 

if  —  -  i« 

9 

215 

35 

35 

131 

217 

*.5 

33 

39 

62 

■'  —  •”  jj- 

Z7t~ 

At 

67 

233 

916 

*NT 

51 

50 

- Z*t 

•Mt 

'■NT 

53 

52 

L0°2? 

»rL 

J 

11  13 

L£  GTM 

InSTACK 

- ft 

2it~ 

•  J 

u  n 

218 

NOT  IRNfR 

— 

36 

210 

< 

17  25 

69 

INSTACK 

- ■‘till 

f« 

3 

33  35 

n 

IHSTRC* 

- — — . 

-  -  — • 

111 

216 

J 

36  37 

- 36- *5~ 

3 

— --->133  —  - 

INSTACK 

-  - 

_ _ _  . 

0 


i»~; 


TABLE  C-l.  (Continued) 


SUSWiHAlc  OROER  /4/?-4~  QPT*4-TftACE - - FTN  4.6*439  04/08/80  18.38.36 

- fcr&OPS LABEL  -  -  INOEX  -  -  FROH-TO  LENGT**-  9ROPERI-1ES - - - 

162  220  J  4?  48  48  INSTACK 

- - a-  -) - 56-66 - *69 - EXT-  REF  S - - 

RANK  4i 3 

- 109 -  --  14  — - - 

- STATIST IOS - - - - - 

PROGRAM  LENGTH  6038  387 

- eH-tA-aetEO-COMMGN  -  LENGTH - 6418 - 41/ - -  . 
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TABLE  C-l.  (Continued) 


StmotjTXfi  7 k/Tk  WI!  t*ac€ 


fix  *.6.»j9 


1 


5 


10 


1$ 


tt 


25 


JO 


3$ 


49 


-5 


5f  “ 


55 


S  CONPUlC  Mt^t«€»*CC 

SUMOUM*  t*tr 

COHKCK  /CDaTa/  N9*  ,NJ,N*T,  N4«£<2,330>.A<199.tl0>,Mt(J:O,tfi<lCU 

•  .  jH^ntQn  im>.J5v*tme  ,ni» 

COMNCn/(C0/h€A3CAUI  ,N0TC0H,NPT  ypI.I^Tt P2,*f  U? ,NP* INT , JT II 
CO-W6H 

cincksich  mTA<e7i,ppnn,KZE»A«*i 

DATA  hOASM/ — . -✓ 

Pa r a  pp/i.  oo,  9.  oil. o.6?5.o.  3  r;>,  9.049. 1.939,9.793. 9. 469. e.?34. 

•0. 117,3.000,1. 090, C. 773*0. 539. 9. 3 j 9.9. 209.0. 126.9. 051.*. *2?, 9. 3S*. 

•  C.917. 0.016, 0.002. 0.009, 1.003. 9. <*49.0.999,0. 769, C.4?9, 9.  S?3.C.  193. 
•3.299«t.?0o.0.t53,0.  994.9.963.0.*. 3r.0.9?Jt0.911,9.9t64.9.9079* 

•  0. 0*1  J,  9.  OCC^.  0. 3  cci.o.c;*. 1.000,0.^76.  C.  990. 0.94,9,8.9  9?.  3.  *13. 

•  j.  7C2, 6u, l.  499  . :.4C0.C.:23,e.2A0«t.:93,t.X39,:. *95,9. e67,t.  945. 
•3. 136, 9. 019. 8. 012, 0.007, 0.0942, 9. 03*3, 0.0013.0. 0106. 0.0903. 

999 1,9. 9  991 1*»  •Oft «  9*  9*9*  »♦»♦♦♦/ - —  - - 

DATA  22CTA/C. 990, 1.000. 0.000, 6. 509,1. 000,0.900,9.200.3.4:0,0.603. 
•9.99C»!.0:.,C.03:,C.m,C.?58.".375*:.5tl  ,*.623,3.753.«.«75.l.l*i, 
•0. 000, 9. 072, 0. 143. 9. 2l», 0. 296, 0. 397, 9. 429. 0.5C 0,0. 572, 0. 66 J, 9. 715. 
•0. 797, 0.459, 0.929, 1. 009, 0. 099. 9. 059,0. ICO, 0.150, 9. 299, e, 290. 9. 39C, 
•0.350, 0.400,0.459, 0.509, 0.553, 0.600,0. 653, 0.790. 0.751, 0. 903, 9. 953, 
♦3. 400. 0. 55  3, 2* 903 ,3. ftr*3. 133,9^66, 3. 193,0.1  33,:. ttr6«o. 291,*.  2*3, 
•0.266,0.300,0. 333, 0. 366, 0.«00* 0.433*0. 466,0.509.0.533,0.566.0.630. 
•0*6 33, 0.646*0. 709. 9.  733, 0.766. 0.900, 3. 933, 0.966,9.5*0. 0.933. 3. <>66. 
•1.0*0/ 

OAT  A  N2CT A/9, 0.1, 3. 6, 12,21*36,57/ 

z  select  type  or  calculation 

COY  At  *0.5  -  — - — - - -  —  -  — 

OVAL-O.O 

AOtfALn.Q 

IP  I6PTYP2.E0.il  CO  TO  93 

EQ-AL-9.0 

UVAL»*1.0 

)3  CONTINUE 

CO  130  J*1,N69 

00  125 

*!J  »  «tI*3t-  -  - - — - - — 

XJI  •  AU.XT 

X«I»JI  •  O.C  - 

Ifl  X  , CQ.  J  I  CO  TO  120 
ire  X X J  ,NC.  XJI  »  CC  TO  119 

ir  irij.ta.4.0  .ano.nptypi.eq.o)  co  to  120 

lttf3l«£om-  -  - - — - - - - 

xij,:i»cqval 

CO  TO  120  - 

113  V  •  1.0 

xr  TXXJ.tT.XJXf  T»t?VA|.  - -  - 

X<I,JI  •  y 

--  - XtJ.J7«A©Y*t-V- - — - -  — — - 

120  CONTINUE 


TPP 1 

16*? 

TPPi 

19M 

TPP1 

19*4 

TPP1 

1015 

IPPl 

10*6 

— -I 

X3*7 

TPP1 

191* 

TPPl 

1514 

T  PP 1 

1946 

TPPi 

l  04  1 

TPP1 

111? 

TPPI 

tCM 

TPP  t 

104* 

TP*  I 

t**f 

tpp: 

1946 

TPP  1 

1047 

TPP; 

1549 

tppi 

1*<*9 

TPPi 

*.130 

l«>1 

till 

TPP  • 

1152 

TPPI 

113  3 

TPPI 

1 : 

TPPI 

UC5 

TPPI 

113b 

TPPI 

it:? 

f®Pl 

1 1:« 

TPPi 

1X39 

TPPJ 

1119 

TPPI 

11:1 

TPPi 

111? 

TPPi 

1113 

TPPi 

1X14 

TH>1 

1115 

TPPi 

111* 

TPPI 

1117 

TPPI 

ill* 

TPPI 

1119 

TPPI 

11?0 

TPPI 

1121 

TPPi 

1172 

TPPi 

1123 

TPPi 

ll?fc 

TPM 

1126 

TPPi 

1127 

TPPi 

1126 

TPPJ 

It?® 

TPPI 

1130 

♦P*i  - 

JH1 

TPPI 

1132 

TPPI 

1133 

TPPi 

1134 

TPPi 

1195 

TPPI 

11  56 

TPPI 

113* 

TPPi 

1135 

154 


V.; 

?• 


TABLE  C-l.  (Continued) 


SlHWMv!  P9’« 


15)  COHtlNjC 

:  so*  *«!*  -  -  -  —  — 

co  is: 

$0*9  •  «.« 

00  1%)  J>t.N3» 

1-9  $0*®  •  SO**  ♦  «(!|JI 
si  S0*A«H  «  S0«t9 

If  (NP9XHT.IQ.5)  f.O  ic  1?5 

*»ptT£**,902»  hcaoc*.  <  j,  > 

9J2  F09*AI  |-;CC*PolC0  PSf'f£»£t<£ 

«4m<6.9C5>  C  NOASh,  ;.:.N59  » 

iac  foaHAi  —  - - -  - 

00  !&«  1*1 « 

169  *9IU(6,9«,)  SUHIO,  I,  I  J.J.N9*  | 

fo*5At  -,i9fi.ni 

S  2  9  CONTIHOE 

CALI  090f9(  -PP£f—  *-  ,4*0  ,  Sv*4-f- 
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oirA((XH(ji,«.ti  ,j«  1.7:1/ 5.,:*. 5.  j$..  *9.5.5?.** 75.  7,  tt.r.ist.  7.  taa 

Mt*.l 

DATA  ICCaiJ.SU«4>l.IiW4„P,,4<,V«4^,tt2.].l».l.»4.4,i4l.7,  TAA 

•7t7.*.?3l.7.75*>*.77#.*.3S7.*.3’t.?.3  ?.«• 173.5*307. |.,?l. „**».*.  f  Aa 

***♦•5/  -  -  -  —  —  -  -  - — - -  — -  «aa 

CATA  CCC«(  J.fc. II  .J»l. ?«>/:.,  $4. . its. t«: 
•X«M 

MlM.IH.r,*t4.5t<>44.?.<>4S..4)>.T.4r:.4,4:4.1,M.1.4l4.l..\'4.i.  T»* 

*XH«V/  TAA 

jat a  (cc«u,7.i» .j#i. ?:>/«..  taa 

MJ.1»  •  --  - - - - - —  —  -  -  ■  W 

•5«.  .571. .471.  A. **(.*.7*7.5. *3*. !«•*•- 5.973-  7.1i?.«,.ii*l  .7.<C94. 4.  TPA 
•11M.W  TP** 

SATA  lU«(J,),?),Jin7SI/:.«7>M4MSXM41.«$X*t$lA,M.4.TS.1a  m 

OATA  (CC«IM«!l<^!.?ei/|.(H..42.,4t.i.l3.i.4«.4,tl4.«,:Jr.*,  TAA 
•144r«A,U4.  MH. ?frt  *** 

•Ha*;/  t» 

OATA  <CC«(J.5.7».A«i.7>  «*» 

r»* 

•**».;/  *r* 

if* 

•1177.7/  *aa 

OATA  <CCm</«7«  It  «/«l  .£?»/* ..1.  *»  .s*5.5«2*£.  .3*?.* H77»*t5*1.7*  TAa 
•579.9.  TAA 

>MN  ^WMtTW*  »WHr>  .*■*».*« -  !<■»' 

•l**J.M5?i.V  Taa 

- - -  -  —  TA* 

OJ  »  »W**9CA  CT  JUCCCS  TAA 

H  »  «J  -  -  TAA 

kU  •  KURSTA  or  AA3JCCTS  TAA 


WWI  •  0 

«•<*«!  tl4tlrtt!»  »mt 
30  It  J  •  X.N 

silt  or  irt-tiji - - — — -  — 

l  •  hJZUlJI 
00  Zt  K  «  I, l 


I  J*J 
1  »J* 
S375 
117* 
11*7 
»?>• 
tl?5 
im 
lih 
HI? 
Hll 
im 
H» 
(AH 
1337 
I  IJ4 
1335 
13** 
S3%1 
II*? 
IM 
4  }*• 
tl«4 
IM 
13*7 
4M 
S3*l 
1  ISC 
1351 

m? 

HH 

im 

ms 

IW 

1357 

IW« 

1  35% 

t«5- 

S3*: 

13*7 

13*3 

IlH 

•3*5 

H>«- 

13*7 

1H* 

1  359 
lire 
1*71 
tS»f 
s  srs 
at- 

1375 

137* 

5377 

-117* 

1379 


163 


TABLE  C-l.  (Continued) 


SYMOUtlWE  COWCOft 


7*77*  OP?*l  »**CT 


IT*  %, 4*419 


3*/64/46  16. <4.36 


<«l,t  » 


$U"R  .  SUHt  ♦  XSUBL 
- H4  Oflt*Uwrt - - - 

«tk*  •  St>«»  /  M 
MRlU<6,9C«l  hCA^m.  t  \0  S", 

444  • jRHAT<Tb|A6,  tft$,24A6>  » 

*»IT£<6,910>  (  t(K»,  «*1.n  l 

-914  fWXAM-  Of  ,*T|*,?4  *«,,!»-♦ - -  —  — - - 

S  •  l.« 

00  129  K*1,N 

124  S  •  S  ♦  t  9«»  -  R9A«  »••? 

WRITE  14*912*  48A«,  ' 

41?  'Q4HA? <7“  *AH  --,M  *.?,5*,**5ttH-«P--:>£w|Af  I o*S -SQUARED  •*-*«#.  m 

K»imb.9io  suhi 

91*  FORMAT  »“  SO*  T  F 10 . 21 

0  «£N0AL$  COEFFICIENT  Of  CONCORDANCE 

0«Cn»t*  |MN*K*H»/12»*«*NSUHI/12 

if  «,.nc. a.)  c*s/p 
her  ■  H  -  1 
ChISQ  •  n  •  NOf  •  C 

If  IC.EQ.4499.1  **ITE~<6,*t6l— - - -  -  —  - 

9l7  FORNAX  </lA,“<£NCAtL$  COEFFICIENT  OF  C0NC0»0ANCE  IS  INDETERMINATE 
•/» 

NRI  If  (6,916)  C»  »,  N 

916  FOPNATl/  1X,"x£nOALLS  COCFICIENT  OF  CONCORDANCE  •  ",£  10  •  3 .5*  • 

•  "1  •"IJ»5*»“*  •**I5/I - - - - 

If  (N.L£.7.ANO.'<.LE.?0)  GO  TO  130 

OffcNCf 

CALL  HOCH  IwHISQ.Of ,P,iCR» 

P*l.-P 

WRITE  t6,916»-CN!SQ,*0F,B - — - - - 

914  rORIAII/"  CHI-SQUARE  «",f 19. 3, U ,“Cf  I* ,57 . “P  »",F6.*1 

PTEST«,05 
00  32.'  3*1,2 

KNOT*"  “  - 

IF  I?.02.PIEST»<hOT*“kOT“ 

«*ITt  <6,92n«MlTH»TfS»“ 


422  FORMAT  liX,*TlAHK  ORDER  ",A3,“  CONSIST!*!  Af,F*.2,-  t  '»EL.“I 
PT£ST««61 
329  CONTINUE 
RETURN 

134  CONTINUE  —  —  — - - - — - - - 

TEST  «  .05 

PT£$T»CCn I H,h, 1 1  - 

00  325  3*1,2 

KNOT*-  "  -  - 

IF  (S.LE.PTEST)  rnou-not- 

HRIT£  16,4211  AHOf  r-TfST,  P  €ST -  --  -  -  —  -  - 

T£St  •  .11 


TPPl 

1*3* 

IMl 

»*!• 

TPPl 

1*34 

tPPl 

1  A  A  8 

TPPl 

1**1 

TPPl 

1**2 

TPPl 

1**3 

IPPI 

I***. 

TPPl 

1**5 

TPPl 

1**6 

TPPl 

1**2 

TPPl 

1**4 

TPPl 

1  9*9 

IPPI 

1*56—- 

TPPl 

1*51 

TPPl 

1*52 

TPPl 

1*51 

TPPl 

1*5* 

TPPl 

1**$ 

TPP1- 

1*66 

TPP  1 

1*6  7 

TPPl 

1*66 

TP  PI 

1*59 

TPPl 

1*61 

TPPl 

1*61 

TPP* 

1*6? 

[-  TPPl 

1*63 

TPPl 

1-6* 

TPPl 

1*65 

TPPl 

1*66 

TPPl 

1*67 

-  IPP|- 

1*66  - 

TPPl 

1*69 

TPPl 

t*7» 

TPP  1 

1*71 

TPPl 

1*7? 

TfP  1 

1*73 

TP*1- 

— 1*7* - 

TPPl 

1*75 

TPPl 

1*76 

TPPl 

1  *1  7 

TPPl 

1*7* 

TPPl 

1*7  9 

TPPl 

—  t*4  ' - 

i*e  i 

TPPl 

1*42 

TPPl 

1*43 

TC°  l 

1*4* 

IPPI 

1*4* 

*  TPPl- 

1*46 

T®Pl 

1*47 

TPPl 

1*46 

TPPl 

1*69 

TPPl 

1*44 

TPPl 

1*41 

—  TPPl 

1*4?- 

TPPl 

1*93 
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IKl  <,*,! 


& 

tjf 


“ABLE  C-l.  (Continued) 


suiojtiv:  congor 


74/7 *  0RT*i  TRact 


RTEST»CCM(«tN»?l 
325  CONflKUC 

923  format  r x* o°der  “»A3» 
175  *CAl  5  « 

«CtURN 

CM3 


COMSISTatiT  If  ",E4.2t“  CEVCL. 


701M5 

te.U. 

TPO* 

T»»l 

1*9« 

TRPj 

t*9f 

T»<*t 

1497 

TRR  t 

:o? 

TRRJ 

1*9® 

SVMSOtlC  REE£t* HCC  *AR  («*2I 

ENTRY  POINTS  W  UN C  REFERENCES 

1  COMJOR  1  162  :76 


YARIABttS 

S'*  TVS? 

RtL 

CCA? ION 

1153 

a 

R£A«. 

array 

COATA 

refs 

J 

620 

c 

real 

REES 

H9 

1162 

ecu 

♦cat 

arra* 

•CFS 

i: 

21 

:< 

622 

c-isa 

Stic 

refs 

151 

617 

3 

real 

REES 

2*135 

6?3 

or 

rcal 

REFS 

150 

0 

KE'OER 

real 

ARRAY 

XOD 

REES 

6 

6  5 

1 

INTEGER 

REES 

*•€4 

625 

It* 

INTEGER 

REES 

150 

631 

J 

INTEGER 

REES 

55 

2*111 

lit 

167 

606 

J*V 

INTEGER 

RtES 

72 

2>37* 

mi; 

INTEGER 

ARvAV 

COATA 

REES 

1 

26706 

JS3SI 

INTEGER 

ARRAY 

COaTA 

»£ES 

3 

776 

JT£NR 

INTEGER 

ARPAY 

RtES 

1. 

15 

Jilt 

INTEGER 

IOO 

REES 

6 

61 « 

JY 

INTEGER 

REES 

77 

612 

Jl 

INTEGER 

REES 

53 

611 

J2 

INTEGER 

»€E$ 

A? 

6  3 

»( 

INTEGER 

REFS 

2*54 

106 

til 

oeezneo 

57 

113 

ll<» 

627 

<NDT 

INTEGER 

REES 

ISA 

60  2 

t 

INTEGER 

REFS 

i; 

DEFINED 

55 

576 

N 

INTEGER 

RfES 

53 

17; 

OEEIN-D 

577 

N 

INTEGER 

REFS 

59 

111 

113 

1*4 

167 

3 

nan£ 

INTEGER 

ARRA* 

COATA 

REFS 

3 

s 

MS* 

INTEGER 

COAT* 

REFS 

4 

3.7 

nqash 

INT “Sf P 

REFS 

10? 

621 

noe 

IN'Cf-r* 

REES 

ns 

60  7 

nES 

IM-t'ER 

REES 

7* 

92 

13 

NEU2 

INTEGER 

ICO 

REES 

6 

160 

14* 

Of  e  It*E9 

13* 

1  (*■ 

166 

172 

OEEInFO 

13 

1* 

1* 

25 

31 

J* 

34 

»r 

15? 

0EEINE0 

139 

OfEJNCO 

133 

OEEINCD 

1*9 

99 

57 

*•41 

OEEINEO 

€3 

At 

«0 

56 

66 

72 

44 

9  = 

’•no 

115 

OEEINEO 

53 

9« 

I.  * 

155 

46 

OEEINcO 

7  C 

AT 

110 

tit 

DEFINE C 

no 

4 

5* 

71 

76 

47 

OFF  ISEO 

e5 

OEEINCO 

76 

46 

oeeinto 

•* 

43 

06 

0£FI*SQ 

7® 

66 

7* 

71 

7* 

'9 

43 

3*114 

115 

121 

126 

4 

•5 

69 

75 

10? 

1  i 

:u 

*il 

125 

170 

DiElMtD 

156 

15? 

l*i 

16« 

59 

62 

63 

6° 

?5 

*5 

109 

3*133 

139 

144 

1*7 

16c 

66 

62 

63 

45 

95 

:J2 

ICS 

114 

119 

(21 

125 

4»  13J 

137 

166 

172 

IEEI^eo 

50 

50 

2*<19 

defined 

1? 

1*9 

152 

OEEINCO 

137 

41 

42 

9: 

VElNfO 

7* 

72 

166 


~r  >  ‘  * 
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TABLE  c- 1.  (Continued) 


subsume  conoor 


VARIABLES 

1  NJ 

—  10  nOTCOn 

:•>  Np»i-»r 
11  npitRi 
i*  M>m? 
255*1  N$!2i 


Sv  Tr>< 
XNfC'SCf* 

INl'SFo 

INTEGER 

INTEGER 

INTEGER 

INTEGER 

INTEGER 


7«»/7<,  OPT>i  IPict 

RCLOCAI  IO*i 
COAtA 

too 

too 

too 

too 

ARRAY  COATA 


ftH  *.***59  9*>  /  C4/S8  iS.M.Jq 


2 

mi 

INTEGER 

COATA 

p-:fs 

*2* 

»E4l 

REFS 

*?* 

►zest 

PEAL 

PCFS 

IS? 

*31 

»EAl 

ARRAY 

PCFS 

*15 

R3A* 

PEAL 

REFS-  - 

12* 

bit. 

s 

PEAL 

REFS 

bl* 

Son* 

»C»L 

REM 

*13 

SUNT 

PEAL 

REFS 

*J. 

TEST 

PEAL 

REFS 

^  *553 

"I 

PEAL 

ARRAY 

CCA  TA 

REF* 

25Nf- 

>CAL 

ARRAY 

COATA 

REFS - 

2570* 

X$U9l 

V£AL 

ARRAY 

CDATA 

PEFS 

7 

OCFIFtD 

XX 

PCSL 

REFS 

*0 

OEFINCO 

f9 

file  names 

NO  IE 

_ 

TAPE* 

MI 

XP.TES 

99 

1C2 

1** 

152 

15b 

EXTERNALS 

ITPE 

ARCS 

REFERENCES 

_  .. 

NOCN 

h 

150 

INLINE 

FUNCTION. 

tTPC 

ARCS 

0£t  LINE 

REFERENCES 

MBS 

integer 

1  INTPIH 

70 

57 

STATEMENT  LABEL. 

—  — 

OCF  LINE 

REFERENCES 

0 

73 

50 

57 

— 

- **  --- 

- *5 - 

_  -  _ 

1ST  ofrinco 
173  OEFIt.EC 


-127  OCflMCO 


:29  of  fine  o 


t-«5  - 
15?  902 

m  *•* 

*07  90b 

*22  900 

*31  910 

- **2  912- 

*55  9i* 


TABLE  C-l.  (Continued) 


SlMRO'JTI'JE  D3N03R  74/74  0PT  =  1  TRACE 


STATEMENT  LABEL 

i 

OEF  LINE 

REFERENCES 

5.1 

916 

-  MT 

145 

144 

463 

917 

-NT 

141 

140 

520 

918 

-  MT 

153 

15? 

551 

920 

"MT 

174 

170 

534 

922 

"MT 

159 

158 

LOOPS 

LABEL 

INDEX 

FROM-TO 

LENGTH 

PROPERTIES 

7 

90  * 

J 

53  94 

1068 

NOT 

INNER 

16 

30 

* 

57  68 

38 

INSTACK 

35 

4  J 

< 

65  66 

28 

INSTACK 

45 

59 

< 

69  72 

5B 

INSTACK 

55 

80  * 

< 

75  93 

369 

NOT 

INNER 

76 

70 

I 

86  88 

59 

INSTACK 

122 

* 

J 

99  99 

49 

EXT 

REFS 

132 

• 

K 

102  102 

49 

EXT 

REFS 

142 

100 

< 

105  106 

29 

INSTACK 

147 

110 

J 

109  116 

323 

EXT 

REFS 

172 

110 

K 

113  116 

48 

INSTACK 

206 

* 

< 

119  119 

43 

EXT 

REFS 

224 

120 

< 

125  126 

49 

INSTACK 

300 

320  * 

J 

155  161 

13B 

EXT 

REFS 

322 

325  * 

J 

16/  173 

17B 

EXT 

REFS 

COMMON  BLOCKS  LENGTH 
COATA  21306 

100  la 


STATISTICS 

PROGRAM  LENGT-»  1572B  890 

CM  LABELED  COMMON  LENGTH  515108  21320 


FTN  4. 84439 


NOT  INNER 


168 


TABLE  C-l.  (Continued) 


SlHPOjlX*£  C0*PAR£  ?•>/?%  0*T.I  TRACE 


#rs  *.9.*1*  3<./C4/*0  15. '9. H 


1* 


70 


75 


su9pcut:ne  cc*pape 

C04tc>i  /CD*»*/  Ne#  .KJ.S4*, 

COH*eN/Ri**/l  X  SIC  (  IOC  •  Si  ,l!  >!  It  :»l  ,IA9<  j> 

DATA  *.A3/5m  ,  **»&£*,<..  / 

KOJ 

NJ«? 

IF 

SO  tc  <*IHI 
09  It  L«*.H* 

If  U.EQ.L)  CO  TO  19 

3NAME<ZULA9<<I 

3*LME<7MLA6<U 

Nsmm-Nw 
NSI7C  <7Unpr 
00  9  Z-1.N9Q 
xsj3ux»ii*iisi:(z(Ki 

J5u3u  u,7)*tisic»r.ii 

5  VONVXMJC 

CALI  CONCO*  _  . 

13  CONTINUE 
LA#«1I«~ 
l A J  >3  • 

RETURN 

END 


tpp: 

TPPI 
TPPl 
TPP1 
1o»x 
TPPl 
TPPl 
TPP| 
T  PP I 
TPC  1 
TPP  J 
TPPJ 
TPPl 
TPPl 
TPPl 
tpp: 

TPPl 

TPP: 

TPPl 

TP»1 

TPPl 

TPPl 

TPPl 

TPPl 

TPPl 


HOC 

H*l 

h:? 

HOT 

h:* 

15*>5 

hoc 

HOT 

t‘9! 

1**9 


1519 

l".ll 

1517 

1913 

151* 

1515 

151C 

HU 

1519 

1519 

1S7C 

1571 

1577 

1573 

157* 


STNJOLIC  REFERENCE  «P  |P«21 


entry 

JOINTS 

31F  L  INf 

REFERENCES 

i 

COm*aR£ 

1 

2* 

V4PIA9I.ES  S'* 

TT»P 

PElOCAT ION 

1133 

A 

P£Al 

ARRAY 

COATA 

REFS 

2 

5  J 

1 

ZmTtC£» 

—  - 

■  REFS - — 

"2*1 7 

-  —  -2M6 

OEFINfO 

19 

2>37* 

.mil: 

X9f£S£3 

ARRAY 

COATA 

REFS 

7 

OEFZNEC 

12 

1 3 

75706 

3*U3. 

INTEGER 

ARRAY 

COATA 

REFS 

7 

DEFINED 

17 

IF 

51 

* 

ZNTfCEP 

REFS 

1C 

11 

12 

IT 

DEFINED 

57 

L 

INTEGER 

REFS 

11 

13 

19 

3‘FIhEO 

1C 

670 

LA« 

ARKA. 

RAN* 

RETS 

* 

A 

17 

13 

DEFINES 

- M - 

*5* 

LZST 

INTEGER 

ARRAY 

RAN* 

REFS 

* 

0 

list; 

INTEGER 

ARRAY 

RAN* 

REFS 

* 

17 

19 

3 

MAM£ 

INTEGER 

ARRAY 

COATA 

REFS 

7 

C 

N3R 

INTEGER 

COATA 

RtFS 

7 

1* 

15 

It 

1 

Hi 

INTEGER 

COATA 

REFS 

OEFZNEC 

7 

50 

N< 

INTEGER 

--  --  -  — 

-REFS  — 

-*‘9 

-  10 

OEF INEO 

6 

t  - 

255*1 

9SZ7; 

IHTEGEP 

ARRAY 

COATA 

REFS 

2 

oefjnco 

1* 

15 

2 

NUT 

INTEGER 

COATA 

REFS 

? 

2*553 

mz 

REAL 

ARRAY 

COATA 

REFS 

? 

25227 

M3 

aCAL 

ARRAY 

COATA 

REFS- 

7 

.9 


A. 


TABLE  C-l.  (Continued) 


SUBROUTINE  COMPARE  74/74  0PT  =  1  TRACE 
EXTERNALS  rvoE  ARGS  REFERENCES 


COMMON  BLOCKS 
COAT  A 
RANK 


LENGTH 

21336 

403 


STATISTICS 

PROGRAM  LENGTH  549 

CM  LA3ELE0  COMMON  LENGTH  523158  21709 


FTN  4.6*439 


CONCOR 

C 

2. 

STATEM 

ENT  LABELS 

OEF  LINE 

REFE 

RENCcS 

0 

5 

19 

16 

36 

ia 

21 

9 

10 

11 

LOOPS 

LABEL  INDEX 

FROM-TO 

LENGTH 

properties 

10 

10  *  K 

9  21 

333 

EXT 

REFS 

NOT 

12 

10  *  L 

10  21 

279 

EXT 

REFS 

NOT 

30 

5  I 

16  19 

46 

INSTACK 

04/06/00  15.30.36 


TABLE  C-l.  (Cjnninued) 


SUJOJTji;  AIOjILC  7*/7*  QPT*I  79AC4 


fTH  }./({/>(  J*. «4. 


Si 


15 


e* 


25 


» 


35 


A3 


A5 


55 


SU4»CUlX*C  9£CuI®£ 

CO* A CH/Mt  1  P  /»*  ,  : *0  i  )•  «  •  *  1  CAS  4 *3  4 1  ♦  Ml  1 2 1  .  JC*{  C  *  <  J  0 1 »  .  X  7  T  .  x «»A  <  .  J*A  t 
C0N*C*  /COATA/  m9»  .nJ.NhT.  Ufl'lX.Itll.tms.Wei.vIMtXI.AJMSi) 
*  •  ‘M«C  ‘•lt.«*5U£U3St,J$UPtt|«9  tin 

ouension  xucH(see,?i  .xswn  su> .  j°*3j  cj::  » 

OAT  A  X «/fc/ 

IF  CA.nr.3l  CO  TO  55 

— 9€"I*0  5-  —  -  -  - 

03  5C  1*1.361 

ACAO  (5,iCeMXU€«lI.A»,J«l.r» 

H«I 

IF  ICOFI9I.NC.6.I  00  TO  *t 
198  f OPNAT ( ? A 1 C I 

-19*1  - - - - 

53  COSfJNJE 

X**llt 

A3 

H9XTC  16.95 •»  - 

a5-  F09NAT  <////T 1 0 ISO£ *  i»X5T  OF  9£C«X9£ KNIS  ANy  PPOj£CTS-» 

•*9I»€ 

131  F09HAT  1/ACXa.2«.?AU.-/-|» 

>5  IC*1 

xx*  a 

00  65  X*t . XHAi 
XSJKXI *9 

5*  JP<tOJ(It*»  -  -  - - - - - - -  - 
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St-S^SLl*  97/1./74  C9»7«S  3-  3-43* 

// 

1-3397 

73737 

!•*«*  C»  IECOhOS  1*73999  C"  S70 «•*«€  USCC 


;•/:■/«(  14.c7.34. 


cutout  fOMii  t«rcv»ffc». 

<H»i*yr  com 

oosxiio'*  rue  »r  ifc:  atic-cf- 

CO«»u»C0  CC  to  C»«c»  »*oe{»M. 

C3*«»utr  C04404  *4C  4ATU4AL  lOCt«tT**4S.  COTrAlL. 
U»OwiilUl  ru«CT2S*.  €  »0"f*  »•  CO»«Ul. 

Ul6CNC-<fftIC  SIM  C*  COSI»iC  C*  *.  C'T.lu. 
UM  STS«UO  AIO  I«IfUi»iUOiW9l, 


0**C£SS  ST*T£w  •  EOUCST. 


t?i  nut  r:T£S 
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TABLE  C-2*  LIBRARY  SUBROUTINE  PRAM 


SUBROUTINE  PRAM!  FVAtVC*  NV*  UA  ),  RETURNS!  SPECIAL*  ChANGC  > 
DESCRIPTION 

PRAM  IS  A  TERMINAL  ROUTINE  WmJCh  IS  USED  TO  ENTER  FLOATING 
POINT  DATA  IN  rREE  FORMA t  «-OPM  *mERE  p«ECISE  FORMATS  ARE  NOT 

practical*  woros  are  separated  hr  non-nu:ierics  SUCH  as  blanks 

OR  COMAS. 


NONE  RETURNS  ZEROS  rOR  FvALUE 

PRAM  LISTS  VARIABLES  ON  T «£  CARD  IN  W«ICH  IT  APPEARS 

! MUST  SE  IN  COLUMNS  *C-7A> 

STOP  GOES  TO  AN  IMMEDIATE  PROGRAM  STOP 

REMARKS 

SPECIAL  SYMBOL  •  TERMINATES  INTERPRETATION  of  The  RECORD  at 
That  POINT. 


INPUT 

JArO  CAUSES  NV  KEY  WORDS  TO  fi£  LOADED  FROM  ARRAY  fVALJE. 
UAsPOSJTIVE  VAtur  mUL  CAUSE  ONE  CA»0  OR  KEYBOARD  ENTRY  TO  BE 

interpreted  for  up  to  u a  floating  point  parameters. 

JArNEOATlvE  VALUE  MILL  CAUSE  ONE  OR  -ORE  CARD  OR  KEYBOARD 
ENTRIES  TO  BE  INTERPRETED  UNTIL  lABSfjA)  FLOATING  POINT 
PARAMETERS  ARE  INTERPRETED. 

KEY  WORDS  MAY  3E  ENTERED  TO  CAUSE  A  NON-STANDARD  RETURN  AS  A 
U At  of  BREAKING  out  of  read  loops ♦  ETC. 


SPECIAL  ENTRY  POINTS 
PRAMINI5LTAPE31 
PRAM0UTCSLTAPE9) 
PRINT  ON 
PRINT  OF 
PRAMS 


SET  INPUT  file  to  desired  unit 

sft  OUTPUT  FILE  to  oesirec  unit 

sets  PRAM  TO  PRINT  ALL  INPUT  RECCRDS 

OPPOSITE  OF  PRINT  ON  CDEF1ULT1 

CALLING  PROGRAM  SHOULD  HAVE  LABELED  COMMON 

common/kpramsx/vordcs) *nuMC?2> 

THIS  ENTP y  WILL  BYPASS  CARO  READ  AND 
INTERPRET  THE  ARRAY  WORD  IN  COMMON. 
Arguments  TO  This  entry  ->OINT  ARE  THE  SAME 
AS  PRAM. 


OUTPUT 

NV  =  NUMBER  OF  PARAMETERS  THAT  WERE  FOUNO  fREST  A*£  SET  TO  ZERO) 
FVAl-JE  =  ARRAY  OF  FLOATING  POINT  PARAMETERS 

CHANGE  =  NON-STANDARD  RETURN  IF  a  C  I  FOR  DATA  CORRECTION  )  IS 
FOUND  :n  THE  DATA  STRING. 

SPECIAL  =  NON-STANDARD  RETURN  IF  A  KEY  WORD  <  SUCH  «S  END  )  IS 
POUND  STARTING  IN  COLUMN  1.  NV  IS  RETURNED  WITH  THE  KEY  WORD 
NURSE*  AND  FVALUEU)  IS  RETURNED  WITH  THE  KEY  WORD. 

THE  FOLLOWING  HAVE  SPECIAL  FUNCTIONS  AND  MAY  NOT  BE  USED  AS 
KEY  WOROS.  ALL  EXCEPT  PRA*  SHOULD  START  IN  COLUMN  1. 

PREV  RETURNS  PREVIOUS  VALUES  IN  ARRAY  FVALUE 

REMARK  PRINTS  REMAINDER  OF  CARO  AS  COMMENTS 
PRINT  ON  PRINTS  ALL  FOLLOWING  INPUT  CAROS  ON  OUTPUT  FILE 
PRINT  OFF  TURNS  OFF  PRINTING  OF  INPUT  RECORDS 


E*AMPtr. .SAMPLE  PROGRAM  „1lL  FIRST  SET  INPUT  AND  OUTPUT  FILES 
TO  TAPE3  AND  TAPE9  RESPECTIVELY,  ThCN  READ  10  VARIABLES 
»£R  CARD  INTO  THf  ARRAY  *  UNTIL  THE  WORD  END  APPEARS  IN  TmE 
INPUT  STRING. 

IF  A  C  APPEARS  IN  ThE  STRING*  THE  3ROG-  AM  .lL  RC-RCAO  ThE 
V  AR I  AH*  £  TO  BE  CORRECTED  AND  FJMS-  READING  T*E  DATA  STRING 
cROM  THAT  POINT. 

PROGRAM  MAl5,tUPUT*0’jTPUT,TAPE3=lNPUT*TAPE9  =  0UTPUT) 
DIMENSION  R«1C> 

DATA  JkE Y/5*-END/ 

CALL  PRAMINCSLTAPFK) 

CALL  PRA«0JTI5LTA»ER) 

CALL  PRAMf ikEY*I*Q) 

99  JAS10 
NVr  1 

1  CALL  PRAM<MNV)*NV*UA)«RrTjRNS<10*2C) 

GO  TO  99 
20  UJrl 

CALL  PRAM{»v*NN* JJ) 

HV-X  V*. 1 
UA=JC-NV*X 
GO  TO  1 
1C  CONTINUE 
END 

EXAMPLE. .DATA 

l.*2.«3.,«.*5.,S.^.*A.,9.,3  0. 

ll«12**13.«l9*i5*l9C 

S 

IS. *17, 16*19*20 
END 
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TABLE  C-2.  (Continued) 


p»i*i  \».  j«  i<  i»ccxut  C«**.5C  i 

51  **Ut:tSCC»«  M«9I(  </«  it) 

C54-54  /»PM"S»/  k5«D(4),  DJ**  9<Ct  •  *3*r«fM2Cl 

L0S1C*L  LIS’ 

tocl** lch;c  <  riitiv  >•  <  joji,  *:tccu:  > 

3*14  US’  /  .f*LS£.  / 

mi*  »■*  / 

3471  IV  /  !.«  I.«  4**  s..  (.•  T.«  ».«  ’./ 

cat*  =*c»  iocf  :•«•/*  **i js/ i •••/ •  »ias»/i« 

3*1*  \4C’/8/ 

3471  FU£I\/Sl!4*v*T/v  Ml? 

4F  s  3 

Iff  4*  .%£*  8  >  to  TO  1C 
i«n  =  \* 

If<  «¥  *t£*  5  I  1£TUM| 

3J  1  J  ••  1*  N«‘T 
3  i25*3<£tij*  ?  fv*(.J(fJ> 

t*f5  CNTH  ~T»*SSCS  0  4=-  3  If  *3  1\P  :4Tf**»»CTS  **5*l  IS  C0SP04 
£SI*t 
Y1  *  1 
63  TO  1? 

1C  CCStJSjf 

*:ocjis»995)  <vo*;u>«  on**  > 

933  *o**'it;  e*ic  i 

Iff  *340111  ,9C.  iflC"!5’  >  53  T:  1? 

rfim<'73JT«93?>  C  fcOlClJI.  ,»??•*  1 
60  TO  13 

1?  !M  LIST. 04.  W040I4J j  *4;trt JOjT.USI  «C*5 
933  r0* ** 1 1 1 *#*15> 

in  sf  .i-.t  >  so  13  is 

in  tfOiDcii  .sc.  i&npaisT  os  >  so  to  u 
LIST  :  .T%yr . 

S3  10  13 

16  Iff  W34Cf 1)  .*£•  10HMIST  Off  I  00  TO  !’• 

List  s  *f*LSf. 

60  1C  It 

If  St  S  U3ST  J*  1 

IM  *345(11  *£3.  SHC«t»  >  *[T*JH 

in  *3*0111  *ra.  *hsto*»  >  sic*  tit 

W  :  f 
StH*5lS£  2  C 
33  St  j:M* 

SO  *TlLJfc«J>  -  B.C 

Iff  W545fl»  *£i.  tsscsf  1  4£Tc** 

IS  SF  S  Ht  *  1 


; 

c 

7 ‘.5 

51 

7C5 

2 

It  t  4*fT  »  SO  "  4; 

7£3 

3? 

.’CS 

3 

4t*i  s  : 

73S 

53 

7  =  3 

• 

I 

C**f r-  *■*«  S*fU*L  4»*  fios 

725 

54 

7C3 

5 

5 

22  It  J  :  1*  V-l? 

75* 

*5 

f  cs 

♦ 

l*t  *20(1)  *4f.  ^C50«(*4j»  1  SI*  »:  73 

7C3 

Si 

705 

T 

r**t.’£«l»  : 

235 

57 

7CS 

• 

\»  s  .* 

59 

7C3 

9 

«£T,44  S“f  tilt 

725 

39 

/7C3 

13 

?C 

C3\’I\.£ 

7S5 

65 

72? 

U 

!‘i  «>i  ;  >  i'i.u 

723 

61 

70S 

12 

z 

723 

42 

7CS 

43 

C^4’I4  •' 

723 

43 

733 

14 

J*  5  \1  •  1 

753 

44 

7C3 

15 

oncost  «*o,«?:i  ,.e*o*  * 

723 

45 

7C5 

16 

e51 

O4«*T<J0*l  * 

753 

it 

7*3 

17 

z 

7C3 

4? 

723 

10 

z 

S£ 44C**  f C*  5TH7  0*  »44  =  4r*ra$ 

7B3 

ii 

7  =  3 

19 

J2  :  1 

7=1 

44 

705 

20 

z 

not?** 

7*3 

75 

7t5 

21 

SC  -CO  JJ  :  JS  M 

72? 

7» 

70S 

22 

lr*  J?  ,SC*  6=  >  S>  TO 

7*3 

77 

753 

73 

SU*  TO  f!9ST  VJ*£*J6 

7S5 

73 

703 

7* 

05  70  j;r J2,«: 

733 

74 

7S5 

73 

14  •  «  J  L  L  Tft«IV*TC  ?«f  »H|4f!£*  US’ 

7C3 

75 

7C3 

76 

Iff  1|J1>  .£0.  il*st  »  Os  TO  “aa 

785 

76 

7:5 

?7 

*  :  «tu  J:*I  *  \0vSt‘T2»O  *-l;*T  to  C-<*%3£ 

7*3 

77 

7  =  5 

2* 

if  i»t  j!  i.cs.i-«:.i\5.  hi  ji»; .  . *  i  j ;  * :  * s . : - ,  *  * 

7=3 

71 

lit 

79 

55  73  1 : 1  «*  5 

7C3 

76 

?C5 

S3 

lr I  if JIT  .£S.  14(1)  )  65  70  *3 

753 

98 

735 

SI 

75 

CC\U\j£ 

783 

91 

7C3 

12 

z 

4. *4  5Jl  Of 

7»3 

•2 

70S 

53 

z 

1 7  „•*  15  *IS*T{tff«  »JO  140?^£4  0453  iUH  V4  IS  SH 13C  If  3 

7  s3 

93 

70S 

S* 

7? 

Jff  .i  .LT.  5  »  so  TC  16 

785 

94 

733 

S3 

SO  to  4»5 

785 

45 

7C5 

S3 

c 

C5-»alf  vi.cC 

7C3 

fit 

7C3 

37 

:f 

283 

47 

7tS 

St 

z 

:54,£tt  1L*"1  TO  4'v4ft:0 

783 

96 

iSS 

39 

;S!S4  J  *1-5 

735 

19 

731 

«S 

tflLJC  :  3.3 

753 

9» 

7*3 

*1 

513  1  *. 

715 

91 

735 

42 

*15  :  lC.C 

783 

92 

755 

43 

Iff  JCJ1).£6*4»luS  »  SO  1C  313 

783 

93 

70S 

«4 

m  65  70  32' 

253 

44 

733 

45 

tsiox  = 

283 

43 

735 

*6 

315 

JJ  s  J1  ♦  1 

7S3 

46 

7=5 

4  7 

329 

5?  365  J2  =  Jl«>3 

283 

97 

70? 

46 

35  33=  J= I  * 1 5 

7iS 

41 

7C5 

49 

|f<  t(J?K!S,niJ)  »  S3  lc  343 

783 

99 

703 

55 

I*-1 


1 

* 


TABLE  C-2.  'Concluded) 


330 

CONTI N  JE 

703 

103 

IF «  A(J2).NE.  PERIOD)  GO  TO  370 

705 

101 

X10  :  1.0 

703 

10? 

310  i  0.1 

703 

103 

GO  TO  360 

705 

1  OR 

3R0 

value  =  value*xio  ♦  xv«j>«oin 

705 

105 

1 F  €  DIO. LT. 1.0  )  010  =  310  •  0.1 

705 

106 

360 

CONTINUE 

705 

107 

w 

705 

108 

370 

FvALUEIJJ)  I  SIGN<V«LUE.ASIGN> 

705 

109 

NV  r  jj 

705 

no 

♦  00 

CONTINJC 

705 

in 

C 

70S 

112 

99? 

CONTINUE 

705 

1 1 3 

IF «  NV  .NE.  0  )  GO  TO  99e 

705 

HR 

WRITE* JOUT. 902! 

705 

115 

90? 

FORMAT ( •  TC U  010  NCT  ENTER  REYWORD  09  NJNCR1C  VALUES  -  TAT 

AGAIN. >705 

116 

GO  TO  10 

705 

117 

990 

IFI  NCNAnGE  .NE.  0  )  RETURN  CHANGE 

705 

118 

C 

705 

119 

RETURN 

ZOS 

120 

ENTRY  PRINT  ON 

705 

121 

LIST  i  .TRUE. 

705 

12? 

RETURN 

205 

123 

ENTRY  PRINT  OF 

705 

12R 

L 1  ST  =  .FALSE. 

705 

125 

Rt  URN 

70S 

126 

ENTRY  OPTION 

205 

127 

READ  90S.  WORD 

705 

128 

ENTRY  OPTIONS 

205 

129 

NOPT  =  1 

215 

130 

GO  TO  lb 

205 

131 

f* 

CHANGE  UPUT  FILE  NAME  ...  EX  CALL  PRANIN*  SLTAPE5  > 

205 

132 

ENTRY  PRANIN 

205 

133 

rILEIN  =  FVALUEU) 

205 

!3R 

RETURN 

205 

135 

C 

CHANGE  OUTPUT  FILE  NANC 

205 

136 

ENTRY  PRAHOUT 

705 

137 

FILZOUT  =  FVALUEU) 

Z05 

138 

ENO 

205 

ISi 

TABLE  C-3.  TRANSLATION  INDEX  ARRANGEMENT  SPECIAL  PROGRAM 


PROGRAM  74/Ti  OPT ■ 1 


FT*  4. 4*4)9  Ot/21/49  10.33.07  1 


- ) - - PPORPA*  WAIN  HMP<JT*OUTPUTlTAPPS*t*PUT»TAPf4«OUTHjT»tAPp»> 

OIUtNSION  WSfTHOO,?} 

- -  — - - - OO't©~T»)»Y40 - - — - —  --  -  - 

QE*0  (5.JOO0)  ARRAY!'. l:f  ARRAY (1.2! 

s  -  -  -  — - 

ir  <€OF(5>.SE.O.)  00  TO  20 

- - i0  jt - — —  — 

?«  !x*I-i 

- — - «*»*Ti50«Jrr*¥7f-?rT»Y0,11 

U  CALL  SOPTL*l  *QRAY.300.IX.?.-1.1«10.1> 

- — - - 

2000  FORMAT  (?Al 0) 

- f>0  15  »«1»»S0 - 

**®ITE  I6*2«0.)  I*  ARRAY  ( I  « 1 1  •  ARQAY(I.2» 

- 1^- -  — !«Wf - -  - - - - - - - - 

200]  FORMAT  (1X.1S.2X.A10.2X.A10) 

-  - *#! T€-f4.?«OP»  It - - - - - - -  - 

200?  FORMAT  (2X,"I*»",I61 

- * — - r—  rHfl-  -  -■  - —  - - 


- RYMROIIC  *CFf  f*CP 

entry  pQi*tr+~  - - — 

6140  MAI* 

■«— »  tp-n - 

VARIARl.**  $N  TYPE 

RELOCATION 

6)2)  IX  I*TF(5F° 

632*  J 

INTEGER 

file  *A*FC  MODE 

2043-  TAP«6 

F*T-  -  - 

4106  TAPER  F*T 

'J 

EXTERNALS  TYPE 

-  —  EOF  - - Rf*t~ 

AR6S 

1 

0  10 

0 

15 

6174 

20 

6312  POO?  F*T 

LOOPS  LAAEl  INDEX 

PROM- TO  LENGTH 

PROPERTIES 

4?I0  *  I 

11  11  14R 

FXT 

REFS 

NOT  INNER 

*  6?1 1  ~ *  J 

6??6  15  •  I 

13  15  110 

...  ..  -  £  XT 

FXT 

REFS 

STATISTICS 

PROGRAM 

PUFFER  LFN6TH 

M5M  3177 

180 


JMM 


a 


TABLE  04.  LIBRARY  SUBROUTINE  SORT 


S^ROJUNC  SO*  T I  N*.  -AC.  v,  l(T2.  NSC.  NCH,  SH}  > 

DC SC* Is! ION 

IMIS  RCJTINC  rflu  IMf  A  TwO  DIMENSIONAL  *****  CONTAINING 
VJNERlC  0®  ALPHANUMERIC  0*TA  iVO  SC  *  T  IT  ACCORDING  TQ  SC*C 

)»pn  s'oyfNc:.  »-e  v.rious  dominations  available  are 

C*u  S0»TNA<NA,"RD...,>  SO*  T  NUMERICAL  ASCENDING 
CALL  SORTNOINA.IAO,... I  SO*?  NUMERICAL  0ESCSNOING 
Ti£  NUHCUCU  SORT  CONSIDERS  T«r  SIGN  *\0  NAQNl TyOC  OF  A 
SIN3L?  SO  SIT  bOAO. 

:*LL  SO*  TLA  IN*. '***>4  SO*  T  .CGIC»L  ASCCNOING 

CALL  RCmOlNA.XAD*  ...>  SC*  T  LOGICAL  OESCENOING 
THC  LOGICAL  SO*  T  IS  jSCO  *0*  AL9hANJN*R IC  DATA  A NO  TmC 
SIOOCNCT  ■  I L  L  ?r  AS  SHO^V  IN  TH*-  ASIANS  PARAGRAPH.  THIS 
S  0  *  T  CONSIDERS  IVOIVIOAL  CHARACTERS  AND  lAt  E*IEN0  OvC* 
HO*:  TmAN  ONf  wPRO. 


INPJT 

1  V A  ARRAY  TO  n  SORTED.  DIMENSION  AS  NA(*TO.LCOL> 

r  «AT  *0*  DI*  0*  NA  iv  CALLING  PROG* AN. 

5  v  number  or  rcn's  to  re  sorted. 

%  V  NJ*BLR  or  COLJ’ANS  TO  RE  SORTED.  IN  .LC.  LCOL) 

all  words  off  va<j«j>  j  .gt.  n  w III  not  9E 
R* POStTIONEO  DURING  A  SORT. 

S  <CYu  COL  OR  ROV  SUBSCRIPT  OF  ‘EGINVIYG  .  ORD  0*  TMC 
PIElO  TO  3C  SORTED. 

-  P UR  SORT  0*  A  COL'JNV  NAlI.KEYtf)  1=1«?*...*K 
♦  FOR  SORT  ON  i  TOW  NA/xEt*.j»  J: J . ?««••« V 

logical  SOWS  ONLY 

S  NSC  STARTING  CHAR  I  -1 0 0  IN  l£Vrf.  C*AR  ARC  LC*T  TO  A 

7  NCH  NU«9ER  Or  CONSiCTIvC  CHARACTERS  TO  *E  SORTED. 

A  VSEO  =C  FOR  81  VAR Y  SORT 

=1  FOR  ASCII  SO.T 


Sh  ! 


OUTPUT 

4  \*  INPUT  ARRAY  SDRTEO  AS  DESIRED. 


A  •:  -  »  R  x  s 

:  T "£  ASCCNOING  0*DER  OF  STEROLS  IS  AS  FCLLO.S. 

:A5C0£FG»iIJ^LHvO»0RS 
Tjvw'‘*E0!?J*S67AA*-« 
/  (  >  t  :  TlANR  •  .  I  (  )  «  -  •  t  •  ? 

<  >  9  \  •  ; 

ASCII  SE2JEVCC  8lan<  5“«S\i*l»**C-*/01 
?JA5ST89IJ3s><**A6C0C 
fghiuxlrncpsrstuvwxy 
?  <  V  '  -  . 

7  ’*•[  .'DAD  iSQW<  BUST  NOT  R?  JSCD.  T-I S  IS  A  CO*»NON 

NA-F  USFO  POP  INTER  ROUTINE  C  0— *UN  I C  *  T  I  ON  • 

EXAMPLE  ...&t  AFC-.*  A  LOGICAL.  ASCENDING  SOU  ON  T  nf  L*ST  5 
Characters  o?  .gad  i  and  the  first  z  character?  of  word  z 
ON  T  Hr  FCLtO»!»‘“  ?  A  T  A  STORED  IN  NAll.J)  1  =  1*?  AND  J=l*5. 


PR3GR1*  *  A  I  N 
DI*:\AI^N  \A I  1 3* 3> 

CALL  SCRTL* I NA. 10*?.  S.-l «S* ?* 1  ) 

AAAAAAA  AAA  AA?CS1?JNS  £  7  ‘ -.CaRC  DC 
A  AAAAGA4AA  AA0C07?3*5  7  “  =»3  ABCOC 

AAAAAEAAAA  A3D0062MS  WMCAA'DE 
AA 090S23NS  67bvCl ?CDI 
A&AAADAAAA  AA005*?3*i  NYPRrASCDE 
A* A AAC A A AA  AA00C3?5*S  S7  A  JOARCOC 
AAAAAMAAA  AA0C0?23*5  67*  TCA0CDE 


AFtER  TmC  AfCVl  SORT  NA  CONTAINS 


A  A  A  AAA  AAA  A 
i AA  AA&AAA  A 

iai.acua; 
aaaaaoaa  a  a 
AAAAAEAAAA 
AAAAA£i; AA 
A AAAAG*  A A A 


/A0001?3%S 
*-00022'*$ 
Aie.'f  ;?3*s 
AJ0C0*2M5 
AAC0052IA5 
*8000623*$ 
4AC00723AS 


SM30A6CDE 
STt’RC.  SCO? 
A7A*0AoCOe 
67  ANC ABODE 
>79*>0A8C0E 
67350A-JCDE 
S7890A8COE 


Rr  FFAENCE 


181 


TABLE  C-4.  (Continued) 


SuP90jt*m  »o;r»  \», 

•sc 

•  NC- 

.  NSC 3  > 

iC5 

1 

<»*. 

1M  »_R{  *  »  ?0P  •  70 

*3j 

'»C5 

2 

67 

*Fl  L AC v  >  70  •  200 

<CS 

S3 

%*»»■*  .57 

S35 

5 

73 

»F|  j-?  1  i?C,  170.  ICC 

535 

SA 

LOGICAL  l>tV*  CLOG*  Ml.  5. 

S35 

% 

sit 

^5 

commdy  /xso^Tt/  llog*  ms* 

V»« 

P 

z 

Sf  5 

s 

IOC 

-10  =  t  JfK  •  LiS-  )  /  2 

SOS 

St 

DATA  HA/0/ 

305 

6 

Jci  9.  )  G J  *3  :c* 

scs 

5> 

E1TRY  ootst 

<23 

7 

jri 

7  7 

<3M 

1A3, 

1C7 

SCS 

58 

LRCV  S  .pals?. 

<05 

6 

125 

lf«  <3-F*ARC<  \£Cv«<rT»*9A<*n*<rv> 

7  7 

1«6* 

1  AO* 

13» 

f  *6 

SO 

llDC  =  .'AISC. 

SOS 

9 

l 

r*Ji  ♦  false 

SOS 

62 

JT  ~  \ 

<fS 

10 

175 

if!  L*CV  »  1  a  C  ,  lie 

scs 

s: 

SO  TO  4 

6-6 

11 

10? 

!e<  L-»tY  1  113  ♦  1 A  0 

scs 

62 

CVT9Y  SORTID 

SOS 

12 

1  10 

Ir«  «i:  -  >  120*  130.  1  50 

SOS 

S3 

lrCv  =  .T»or. 

<:s 

13 

120 

L*M  r  -  |; 

5P5 

6* 

LL  PO  2  •  f  <L  SC  • 

SCS 

1A 

SC  TO  KO 

SOS 

65 

JT  *  A 

605 

IS 

133 

NS'tK  r  *10 

SOS 

66 

so  to  :» 

SOS 

16 

SO  70  J 70 

52  6 

*« 

ENTRY  <ortu 

St  5 

17 

1*0 

I e <  JrST  -  -JO  7  ISO*  160.  160 

SCS 

6e 

Lfti V  S  •fALSt. 

SOS 

ie 

ISO 

JMT  ; 

SOS 

69 

JT  t  1 

SC5 

19 

SO  TC  KO 

S05 

70 

30  TO  * 

SP5 

70 

1 4  C 

1ST  ART  -  .j;  ♦  j 

SOS 

71 

CSTST  SORTlC 

SOS 

21 

1  73 

COITINJ- 

SOS 

7? 

lrev  =  .TRJC. 

scs 

22 

30  193  «=1**m 

SOS 

73 

JT  2  2 

SOS 

23 

IF  1  5.  .  SMOL.*'  s  N4CM.J1 

SPS 

7A 

A  LLOO  s  • T p U t * 

scs 

?  A 

If  <  NL  1  1H0L3  =  NAl J,< ) 

SOS 

75 

M3  =  9SC0 

SOS 

?s 

Mi  -  J  •  1 

scs 

76 

MS  =  MAYOl  1*  isc  7 

S  PS 

26 

33  190  L=NSTART.<2 

scs 

77 

NC  =  VCM 

SOS 

27 

53  -  <3  1 

scs 

78 

s  :okt i 'iji 

sts 

28 

IF<  5.  7  NA  t  M . M ' 7  =  SAfM«5*-17 

SOS 

79 

IRD  =  5*0 

SOS 

29 

I F  C  It  )  N4<ni4)  r  Vmj-I.O 

scs 

AO 

SOS 

30 

1  °3 

cc‘.fi  wr 

SPS 

*1 

<*.T  =  1  test  K-  > 

SOS 

31 

IcC  <1  7  MU5*K3-1)  =  MH0L3 

SOS 

82 

|M  \ET  »  7*  7*  6 

S05 

32 

J-C  9l  >  94 ( <  3- I  *  *  7  r  MM0L3 

SCS 

Pi 

6  <1  =  *T*„C. 

SOS 

33 

195 

CDlTlYJt 

SOS 

M 

U  2  .FALSE. 

505 

3A 

2CC 

C3VTI1JC 

SC5 

85 

11  r  1 

SOS 

35 

£ 

SOS 

*6 

HK  =  M 

scs 

36 

DO  220  J=2.\H 

scs 

87 

CO  TO  » 

SOS 

37 

I*C  ML  >  GO  TO  205 

scs 

88 

7  <CL  =  .FALSE. 

sc 

J« 

lr (  53M>.<t<  9A<KEY*J).\A(5CY«J-:) 

7  7 

2P6* 

??c« 

237 

505 

99 

NL  =  .TRUE* 

SCS 

39 

2  0S 

I  F  (  KA(J«MLY»«  9A<  J-l  ,^tT7  7  7 

206  * 

22P* 

207 

SOS 

90 

11  =  1 

scs 

AO 

2  06 

I F  <  L*EV  7  220  *  210 

scs 

91 

MM  r  H 

SOS 

♦1 

207 

1*1  L  A" V  7  210  «  220 

SOS 

92 

3  CONTINUE 

SOS 

A2 

2 1  G 

51  =  J 

5CS 

93 

1ST  AMT  :  1 

606 

A3 

it  my  s  i 

-os 

9A 

30  200  J=2«NN 

SCS 

AA 

**!\T  902.  IT 8 Y #  Ml 

SC5 

95 

<2  s  J  -  1 

SOS 

AS 

93? 

FORMAT  ( *  SOmETh-.sS  WRONG  JITh  SORT 

-- 

-  9TRY  5*13*  Ml  =  *  1 A  ) 

SOS 

96 

JrST  =  1 

$05 

A6 

RCt JR\ 

SOS 

97 

LAST  =  <2 

SOS 

A7 

220 

COlT iMJi 

SOS 

98 

IFt  ML  >  SO  TO  65 

SOS 

A8 

300 

RET-Rv 

SOS 

99 

lf«  AOMPARCl  MAtKLY*J>*1AC<CT**(2>  )) 

66* 

200- 

67 

SvS 

19 

E  A  J 

SOS 

.00 

65  IF C  KO"RAR£C  NA t J«k£Y> «NA(K2 *«C Y)  77 

66* 

200* 

67 

SOS 

50 

TRUE  •  FALSC 

SOS 

SI 

TABLE  C-4.  (Concluded) 


FUNCTION  OMPARY  J  *J1  <  V?  ) 

SOS 

1 

THIS  FUNCTION  is  L'LLtD  BY  SJ330UT1NE  SOW. 

SOS 

» 

CTHNON  /*SC3T*/  L  L  05  fl  NSC.  VCh, 

Nsr:.  ican,  no 

S05 

3 

JINENSION  NIC),  N2  (  1  > 

SOS 

A 

LOGICAL  LLC5,  LOBD 

S05 

5 

SOS 

6 

1 F I  LLC5  )  GO  10  1  GO 

S05 

7 

I F  €  Nl(l)  -  N‘  d)  )  20.  30  <  A? 

S  05 

e 

20 

N3RANC-1  =  -1 

SOS 

9 

3C  TO  50 

SOS 

10 

30 

N3RANCH  a  0 

S05 

11 

GO  TO  ‘.0 

SOS 

12 

*0 

N9RANCH  a  »1 

S  05 

13 

50 

OHSA9-:  -  N3RANCM 

S05 

1A 

RETURN 

S05 

IS 

S05 

16 

100 

Ic(  LORO  1  GO  TO  130 

S05 

w 

no 

KOHPARE  =  WTCOHPI  NSC.  VI  » 

NSC ,  N?  ,  NCH, 

NSEO  > 

SOS 

18 

RET JRN 

S05 

19 

S05 

20 

130 

J  =  1 

S05 

21 

NC  a  10 

S  05 

22 

JCll  a  NCh 

S05 

23 

JSC  a  NSC 

SOS 

2A 

nt  jsc  -  i  )  no.  no.  iso 

S05 

25 

no 

ic<  j:h  -  io)  no.  no,  ito 

SOS 

26 

150 

l f i  jsc*jCH-nmo,  no,  200 

S05 

27 

170 

IF!  WTCOMPC  JSC,  N1IJ1.  JSC,N2(J),  NC,  NSEO  1 

)  20,  180,  AO 

S35 

23 

1  HO 

JCH  a  JCH  -  10 

S05 

29 

JSC  A  NINO!  1.  JSC  ) 

SOS 

30 

J  A  j  *  IRO 

S05 

31 

190 

NC  a  NINO!  10,  JCH  > 

S05 

32 

IF!  NC  J  30,  30,  170 

SP5 

33 

200 

NC  a  n  -  JSC 

SC5 

3A 

JCH  a  JCH  -  NC  ♦  10 

S05 

35 

30  TO  WO 

SOS 

36 

END 

S05 

37 
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pfscedi-.g  ?a3S  sunk-sot 


FliMSD 


Five  example  problems  that  have  been  aggre¬ 
gated  by  the  computer  code  are  included  in  this 
appendix.  The  examples  were  selected  to  present  a 
representative  coverage  of  many  of  the  options  avail¬ 
able.  All  of  the  examples  are  for  five  judges  rank¬ 
ing  seven  alternatives.  The  examples  are  briefly 
described  as  follows: 

Example  Problem  Number  1:  Aggregation  of 
complete  lists  of  unweighted  projects. 

Example  Problem  Number  2:  Aggregation  of 
incomplete  project  sublists  which  have  been 
synthetically  completed  and  multiplicatively 
weighted. 

Example  Problem  Number  3:  Aggregation  of 
complete  project  sublists  with  multiplicative  weights 


and  judge  self-evaluation  ratings  without  a  minimum 
self-rating  threshold. 

Example  Problem  Number  4:  Aggregation  of  com 
plete  project  sublists  with  multiplicative  weights 
and  judge-  self-evaluation  ratings  and  with  a  40  per¬ 
cent  minimum  self-rating  threshold. 

Example  Problem  Number  5:  Aggregation  of 
complete  project  and  one  requirements  sublist, 
unweighted. 

The  input  run  control  and  data  cards  for  all 
five  example  problems  are  listed  in  Table  D-l.  The 
key  inputs  are  again  listed  at  the  beginning  of  each 
example  problem  output.  Example  Problems  1,  2,  3,  4 
and  5,  outputs  are  on  Tables  D-2,  D-3,  D-4,  D-5,  and 
D-f,  respectively.  The  first  pages  of  Table  D-2  con 
tain  the  Load  Map  for  the  computer  code. 
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TABLE  D~1 


1 

etc?*  * c  :« 

$J  ‘7i% 

CC*  Pl'TC, 

C 

V 

t!  ; 

r  c 

’ 

PC  £  rr*j 

1 

59\'  A 

f 

frc  t 

\ 

PCCJ  T 

4 

i'f-zj  : 

t 

-aOJ  * 

(. 

t 

7 

f»5 

JI»6C  ’ 

1 

?  ’ 

4 

* 

• 

Jft'f.E  ?* 

" 

7 

?  -t 

X  m  ■ 

t  4 

• 

jitgc  ? 

t 

4  -* 

t 

j  7 

• 

jir  r.f  * 

l 

7  L 

*?  ’ 

-4  * 

• 

j!;ro£  * 

4 

l  Z 

1 

“  t 

• 

f'C 

* 

'*  c 

: »iKCLf 

£PCF  \C  ?. 

y  7. 

•  *yL7 

7 

c  c 

C  c 

c 

7 

7  p.CJlCTJ 

1 

c?CJ  A 

4 

7 

PPOJ  •, 

'» 

PPOJ  c 

L 

4 

r=cj  r 

l 

r 

p°CJ  £ 

1 

f 

r^0J  r 

4  ' 

7 

=cOJ  c 

1 

f*  r 

jit  re  i 

1 

1  K 

i 

7  Z 

4  * 

f  7 

• 

Jl  CGE  ? 

i 

1 

7 

3  -4 

1  ‘  £ 

JITGE  3 

i 

4  * 

4 

f 

• 

•pi^sr  <• 

» 

<  1? 

7  ( 

-?  : 

-4  * 

• 

JUvGE  5 

i 

i 

'WUC 


iiSVi 


TABLE  D-2. 


TECHNOLOGY  PLflNfJIiG  °RIORlTIES 


EXAMPLE  PR03  NO  l,  5 J  X7A,  COMPLETE,  NO  WEIGHTS 


NNT  =  0  NPTYP1=  <3 


NaTYH2=  0  MAT«=  0 


THE 0=8.  60  NPRINT-  6— - - 


INPUT  REA 0  IN  PROJECTS 


INDEX  ELEMENT  NANS 


WT  CAT 


1  PRO J  A 

l  PROJ  B 

S  PROJ  0 

PROJ  0 

5  PROJ  E 

6  PROJ  F 

7  .  P.ROJ  G 

C  END 


0.  3 

0.  3 

0.  0 

0.  0 

«s  -  - 6- 

C 
0 
0 


0 

0 

0 


i 


TABLE  D-2.  (Continued) 

£«*HPEE  PRD0  NO  1.  5 J  «?J,  COTPLETE,  NO  HEIGHTS 

JJ3CE  1  JCOlV  »  0  JUDGE  HEIGHT  s  0.0  JS£  <»LU£  EIHIT  «  0 

T3TGL  N33  JET  s  7  HU  THIS  JUOGE  *  1 

-l»2»3*G»$»6»-7-  - - .... 

JUDGE  2  JCONT  *  0  JUOGE  HEIGHT  *  6.8  JSE  *JLUE  EIHIT  •  6 

-TOTJl  H83  JET  »  7  HR  THIS  JUOGE  «  2  - _ _ 

7»  2s  i  »  Js  t»  6  »  S 

JUDGE  J  JCONV  *  E  JUOGE  HEIGHT  s  J,;  JSE  *JEUE  EIHIT  *  • 

TDUe  H32  III  !  7  H?  THIS  JUDGE  »  3 


JUDGE  %  JC0N6  s  o  JUOGE  HEIGHT  •  6.0  JSE  TJEUE  EIHIT  •  \ 

TDf  Jt-H8*  JET  •  7  -  N*  THIS  JUDGE-* G - - 

I*  7  »  b  s  2  »  Ts  G  >  5 

JUDGE  5  JCCNV  *  .  JUOGE  HEIGHT  *  t.E  JSE  VJEUE  EIHIT  »  ( 

TDIJL  NB*  JLT  ■  7  NA  THIS  JUOGE  =  S 


i  1 


TABLE  D-2.  (Continued) 


SUB-LIST 

FRE3UEMCT 

MATRIX 

EXAMPLE  PR03  NO  1,  5J  X7A,  COMPLETE*  MO  HEIGHTS 

JUDGE  1 

1  > 

2  >  3  > 

«*  >  5  *  6  ■>  T 

PRO  J  1  2  3  h  5 - 6 - f- 


t 

I 

0.0 

1.9 

1.9 

1.0 

1.0 

no- 

-l.fr  — 

2 

T 

0.0 

0.0 

1.0 

1.0 

1.0 

1.0 

1.0 

3 

I 

■* 

W  *fc 

% 

V  • 

O.i 

l.C 

1.1) 

1.0 

1.0 

4 

I 

0.0 

0.0 

0.0 

0.0 

1.0 

1.0 

1.3 

5 

I 

0.0 

0.0 

0.0 

0.8 

0.  9 - 

“liO"' 

- fryft  - —  - - '  - - 

9 

I 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.0 

7 

I 

t  •  J 

0. 

w  oU 

C*U 

C.b 

O  .0  —  - 
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TABLE  D-2.  (Continued) 


WB-fctS*  FSEQUENC/  1ATRIX  -  — €XA«Pt€  PftOa-WO^-r-W-XTA.-GOHPLETe^-N®  HEIGHTS 

JJDGC  2  -  7>2=>4»3=1>  6- >  -5—  -  — -— - - - 


TABLE  D-2.  (Continued) 


SUB-LIST  F(?E(JUiNCr  MATRIX  EXAMPLE  P<?OB  NO  1,  5J  XT  A,  COMPLETE,  NO  WEIGHTS 

— UOOGE  3  3»  k  -  5  *  6=  T>  1>  2  -  ■  - 


I 


— t~r  o,o  t.o  o.o 

2  I  0.0  0.0  0.0 

- 3  I  lyfl-  1.0  0.0 

'*  I  1.0  1.0  0.0 

- 5~i - tvO — "1. —  “0v3 — 

6  I  1.0  1.5  0.0 

— r  i —  no  i.o  0*0 


0.0  OyO  '  Oyfl - 0;tJ - 

0.0  0.0  0.0  0.0 

i.o  i.o  no  lvO  - - — 


0.0  0.0  0.0  .5 


0.0  0.0  .5  OvO - —  - - 


TABLE  D-2.  (Continued) 


CONPUTEO  PREFERENCE 

MATRIX 

EXAMPLE  PRO 9 

NO  1.  5 J 

X7A .  COMPLETE.  NO  HEIGHTS 

SUM 

1 

2  3 

4 

5 

6  7 

- 

— 

4#5  1 

r 

0i»- 

l.-fl  .5 

0.0 

“trO - 1.0 

- - 

-  -  -  -  - 

3.5  2 

I 

3.3 

3.0  l.C 

.5 

1.0 

1.0  0.0 

4.0  3 

I 

.5 

0.0  0.0 

.5 

1.0' 

1.0  1.0 

— 

* 

5.0  4 

I 

1.3 

.5  .5 

0.0 

1.0 

1.0  1.0 

2.0  5 

I 

0.0 

0.0  0.0 

0.0 

0.0 

1.0  1.0 

—  — 

- 

0.0  6 

I 

3. 3 

-  •  u  u  •  C 

c.o 

0.0 

0  *u  0 • G 

2.0  7 

I 

0.0 

1.0  0.0 

0.0 

0.0 — 

i.o  -  --a.*  -  - 

“"*■  '  —  “ 

- 

“  -  - - "  "  - 

PREF 

k  >  i 

>  3  >  2  > 

5  * 

7  »  6 

NUH3ER  OF  FR4C 

TION4L 

S'JMSs  2 

L3HER 

N= 

7 

KENDALL  0 

s 

4.00 

ZETA  = 

.7143 

PR03 

THAT 

RANK 

OROER  NOT  CONSISTANT 

RANK  OROER 

CONSIST  ANT  AT  .05 

LEVEL 

RANK  OROER 

NOT 

CONSISTANT  AT  .01 

LEva 

" 

*  *  ~ 

— 

UPPER 

Ns 

7 

KENDALJ  0  =  - 

5.00 

ZETA  -*■ - 

-6429- 

- PROS' 

-T~WAT- 

'RANK 

-OROER-NOT  CONSIST A-NT 

RANK  ORDER 

NOT 

CONSIST  ANT  AT  .05 

LEVa 

-  - 

RANK  OROER 

NOT 

CONST 

START  AT  .01 

LEva 

AVERAGE 

N= 

7 

KENDALL  0  = 

s 

4.50 

ZETA  = 

.57  66 

PROS 

THAT 

RANK 

OROER  NOT  CONSISTANT 

RANK  OROER 

NOT 

CONSIST  ANT  AT  .05 

LEva 

RANK  OROER 

NOT 

CONSISTANT  AT  .01 

LEva 

- 

- 

- 

— 

.0  333571*. 


-.-9690*65?- 


.05121429 
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TABLE  D-2.  (Continued) 


un'nit  i 

ffUfCnPt 

i 

-*Z=0  FR 

£2UEN0Y 

MATRIX 

-FUZZY 

example  prob  no  i. 

i 

-  1 

2 

3 

4 

5 

6 

7 

l  I 

0.0 

•  b 

--▼5  • 

-.4 

.7- 

-.0 

•  6 —  —  — 

2  I 

t. 

.6 

.5 

*  8 

.7 

.4 

3  I 

.5 

•  * 

8.0 

.5 

1.0 

.8 

•  6 

4  I 

.6 

•  V 

.5 

0.0 

.9 

.6 

.6 

5  I 

.3 

.? 

0.0 

.1 

e.o 

.6 

.6 

3  I 

.2 

.3 

.2 

.2 

.4 

j.e 

.3 

7  I 

•  *» 

•n 

.4 

.4 

.4 

.7 

0.0 -  - 

F<R»  = 

.407 

-C«R>  * 

.593 

—  - -  — - 

PROJEO 

T 

1  2 

3 

4 

5 

b 

7 

FUZZY 

RANK 

.so  . 

SO  .SO 

1.00 

0.00 

.40 

*60 

FUZZY 

4  »  2 

«  3  * 

1  s 

7  > 

6  > 

5 
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TABLE  D-2.  (Continued) 


-RANK-ORDER  NOT  CONSIST**?-  AT  .05  LEVEL.  CRITICAL  S  =  27B.20 
RANK  ORDER  NOT  CONSISTANT  AT  .01  LEVEL.  CRITICAL  S  =  343.80 
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NEAN  =  0.00  3JN  OF  OEVIATIO 


Stiff  T  =  .50 

<£NOALLS  COEFIGIENT  OF  CONCORDANCE  = 


S'JN  OF  DEVIATIONS  SQUAREO  =  100.50 


N  *  2 


RANK  ORDER  COVSXSTANT  AT  .05  LEVEL.  CRITICAL  S  *  92. 10 

-RAHK-OROER - -CONSIST  A  NT  AT  .01  LEVEL.  CRITICAL  S  * — >«».!« 


ii..^  f 


TABLE  D-2.  (Continued) 


UNMEI6HTE0  SUBLISTS 

- i - 

JUDSE  - 


FUZZY 


0r~et£»IEHT  -  — 

— - j.  -  %  -  —  5— 


E*  NO  HEIGHTS 


8.00  SUN  OF  DEVIATIONS  SQUARED  =  95.00 


KENDALLS  COEFICIENT  OF  CONCORDANCE  *  .931 


RANK  ORDER  NOT  COTSISTANT  AT  .05  LEVEL.  CRITICAL  S  =  97.00 


>V»A, 


!?W 


RANK  ORDER  NOT  CONSTANT  AT  .05  LEVEL.  CRITICAL  S  *  97.39 


TABLE  D-3.  ( Continued) 

EXAMPLE  *RO-i  NO  2.  5J  X  7A, 1 NCOMPLSTC.MUlf  HEIGHTS,  ST H  COMPLETION 

JUDGE  l  JCOVV  *  J  JUDGE  HEIGHT  *  1*0  JSE  VALUE  Ll"IT  *  10 

TOTAL  NBR  ALT  *  7  NR  THIS  JUDCE  *  1 

1  >  2  *  3  >  S  »  6  >  7  —  -  - - - - - - - - 

JUDGE  2  JCONV  •  3  JUDGE  HEIGHT  *  1.0  JSE  VALUE  LIMIT  •  5 

TOTAL  N6R  ALT  *  7  NR  This  JUOG€  *  2  —  —  — 

7  >  2  *  *  >  !*  *>  >  5 

SUDLI5T  IS  IMDOMP. ET£ 

JUDGE  3  JC01V  *  3  JUOGE  HEIGHT  *  A.O  JSE  VALUE  LIMIT  «  W 

TOTAL  NOR  ALT  *  7  NR  THIS  JUOGE  *  J 

5  ►  6  *  7 

SU3LIST  IS  INCOMPLETE 

JUOGE  *»  JCOVV  *  3  JUOGE  HEIGHT  -  2.0  JSE  VAtuE  LITUT -•  10 

TOTAL  NQT  ALT  *  7  NR  THIS  JUOGE  *  A  -  - 

l  *  7  >  S  «  2  >  3  ■  G  >  5 

JUOGE  5  JCONV  ■  3  JUDGE  HEIGHT  *  1.0  JSE  VALUE  LIMIT  *  5 

TOTAL  NBR  ALT  <7  NR  THIS  JUOGE  a  5 


4  >  J  >  2  >  1*  ?  >  *>  6 


TA3LE  D-3.  (Continued) 


-sua-bfST-  FREauENcr  matrix 


E X  AMP LE-P R08-  NO-2-, — S3— X-7  A-, INCOMPL £T  £,  MUL T  HEIGHTS,  SVN  COMPLETION 


Jvtfutr  * 


1  >  2 


3  >  4  »  5  >  6  > 


~-2— 


-3 . -4 — —  5 - --6 - f- 


-i — I'  6.0  1,0-  -1*0  1.0  1.0-  -  l-*0 - 1.0 - 

2  I  0.0  0.0  1.0  1.0  1.0  1.0  1.0 

-3 — I - 0.3 0.0'-  -O.O - 1.0 - 1.0 - 1-irO - l.T)*  - 

4  I  0.0  0.0  0.0  0.0  1.0  1.0  1.0 

■5 — J - 0-ru  — 6-.- - 3-,-j —  -o-»0 - trrO - i»-0 - 1-»0 - 

6  I  0.0  0.0  0.0  0.0  0.0  0.0  1*0 

■? — I - 0.0 - 0*9  — 0*0  —  0.0'  0.0  — 9*~fl - 0.-9 - 


-HeiGHTEO  St»*tIST  FREauSNCY  MATRIX  EXAMPtE  ^R08-M0  2,  5J  X  7 A, INCOMPLETE ,HUtT  HEIGHTS,  SYP  COMPLETION 

—30065-1 - -  •  -  - - .... 


PftOJ - 1 - 2 - 3 - 4 - 5 - 6 - 7- 


II - ttrO  — 6s - 6.-0  -*.0  — «tO - 8t0 - Orfr 

2  I  -0.0  0.0  S.O  0.0  6.0  6.0  6.0 

-3-1 - Oifl - OsO  0.  0  16.  0  16.0  "16v0 — HnrO- 

•*  I  0.0  0.0  0.0  0.0  4.0  4.0  4.0 

-5-1 - O-rt - Ott---3-s-= - 3s  6 - OrO - 4v8 - 4-yfr 

6  I  0.0  0.0  0.0  0.0  0.0  0.0  16.0 

7  1  0.0  0.0  Os 0  0.0  O.fl*"  Os 0  0.0 
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TABLE  D-3.  (Continued) 


SOB-LIST  FRE3UENGY  MATRIX  EXAMPLE  PROS  N0~2,  X  7A,INCOMPLETE,MliLT  HEIGHTS,  SVN  COMPLETION 


- JU06E  Z 

r  » 

2  *  4 

>  1  > 

6  » 

5  » 

3 

"TWT 

X 

C 

4 

-  i 

I 

0.0 

0.0 

1.0 

0.0 

1.0 

1.0 

0.0 

z 

I 

1.0 

0.0 

1.0 

.5 

1.0 

1.0 

0.0 

-  3 

I 

0.0 

0.3 

0.0 

0.0 

0.0 

0.0 

0.0 

— 

4 

I 

1.0 

*  5 

1.0 

0.0 

1.0 

1.0 

0.0 

-  -  9 

I 

•  c 

-  • 

1.  . 

£  •  u 

v  ,0 

0,0 

-  4.0-  -  -  - 

- - 

-  - 

— 

— 

--  - - 

6 

I 

0.0 

0.0 

1.0 

0.0 

1.0 

0.0 

0.0 

7 

I 

1.0 

l.G 

1.0 

1.0 

1.0 

1.0 

0.0 

— 

HEIGHT EO 

SU9- 

LIST 

FREQUENCY 

MATRIX 

EXAMPLE  PROB 

NO  Z,  5 J  X  7A, INCOMPLETE, MULT  WEIGHTS,  SVN  COMPLETION 

JUOGE  2 

PROJ 

i 

Z 

3 

4 

5 

6 

7  - 

-  -  - 

1  I 

a. a 

$  • 

8.~ 

0.0 

8.0 

8.0 

0.0 

Z  I 

3.0 

0.3 

8.0 

4.0 

8.0 

-.0 

0.0 

3  I 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4  I 

4.0 

2*3 

0  . 

4.3 

0.0 

4.0 

6.0- 

4.0 

-8t0  - 

0.0 

9  l 

U  •  4 

4»  : 

2  •  C 

u  “ 

&  i 

0.0 

0.0 

16.0 

0.0 

16.0 

0.0 

0.0 

r  i 

4.0 

4.0 

4.0 

4.0 

4.0 

4.0 

0.0 
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TABLE  D-3.  (Continued) 


SUB-LIST  FREJUENCY  MATRIX  EXAMPLE  PROS  MO  2.-5J  X  7  A  *  INCOMPLETE*  MULT  HEIGHTS.  SYN  COMPLETION 

•  “JUDGE  3  5»6*7>1*2»3*4 


PRO  J-  - 

1  • 

2 

3 

-  4 

5  - 

6  — 

-  7 

- 1  I 

o.e 

.5 

.5 

.5 

0.0 

0.0 

0.0 

2  I 

.5 

0. 

.5 

.5 

C  •  j 

0.0 

O.C 

—  3  I 

.5 

•  3 

0.0 

.5 

0.0 

0.8 

0.0 

4  I 

.5 

•  5 

.5 

0.0 

0.0 

0.0 

0.0 

- 5-4- 

-  1.0 

i.o 

1.0 

1.0 

0.0 

1,0  - 

1.0 

9  I 

1.0 

1.0 

1.0 

1.0 

0.0 

0.0 

.5 

7  I 

1.0 

1.0 

1.0 

1.0 

o.e 

•  9 

0.0 

MEIGHTEO  SUB-LIST  FREOUE NOT  MATRIX  EXAMPLE  PR08  NO  2,  5J  X  7 A, INCOMPLETE. MULT  HEIGHTS,  SYN  COMPLETION 

-  JUDGE  3 


■PR3J-- 

t 

2 

3 

4 

Jr 

6 

7 

t  I 

0.0 

16.0 

16.0 

16.0 

0.0 

0.0 

0.0 

2  I 

16.0 

0.0 

15.0 

16.0 

0.0 

0.0 

L  .  0 

3  I 

32.0 

32.0 

0.0 

32.0 

0.0 

0.0 

0.0 

'*  I 

0.0 

s.o 

8.0 

0.0 

0.0 

0.0 

0.0 

- 5-i 

— 16.0  - 

16.0 

15.0 

16.0 

0"y0 

16  r  8 - 16.0- 

6  I 

64.0 

64.0 

54.0 

64.0 

0*0 

0.0 

32.0 

fi  W 


TABLE  D-3.  (Continued) 


~Sit9~tiS+ 'FRSaUENCY  MATRIX 


EXAMPLE  PROS  NO  2,  5J  X  7A, INCOMPLETE, MULT  HEIGHTS,  SYN  COMPLETION 


-33&3E  4 


i>  7  >  6  =  2  >  3  *  4  >  5 


■PW - 

-  1 — 

2—  - 

—3 

-  H 

5 — 

- 6  - 

—7-  - 

— t_jT.  - 

0.0 

1.0 

1.0 

1.0 

1.0 

1.0 

1.0 

2  I 

0.0 

0.0 

1.0 

1.0 

I.o 

.5 

0.0 

—  5  — 

~  V  ,0 

0.. 

3 . 

.5 

1.4 

0  .6 

0.0 

4  I 

0.0 

0.3 

•  5 

0.0 

1.0 

0.0 

0.0 

- -5-  "5 - 

— 3.3 

0.3 

0,0- 

0.0 

3.0 

•  -0tt0- 

— 0.3- 

6  I 

0.0 

•  5 

1.0 

1.0 

1.0 

0.0 

0.0 

- -7-1- 

-0.6 

-i. 

l.^ 

l.v 

l.C- 

i.o- 

o.O 

-HEISMTEB  SOB-LIST  FREQUENCY  MATRIX 
-0tJ86£“4 

-PR8d - 1 - 2 - 3 -  4-  5 


EXAMPLE  PROS  NO  2,  5J  X  7A, INCOMPLETE ,MOLt  HEIGHTS,  SYN  COMPLETION 


5 - 6 - 


“  ft 

2  I 
—  3  I- 
4  I 

8*8 

0.0 

3.3— 

0.0 

...  ft  .« _ 

16.0 

0.0 

!i  .0 
0.0 

A--  -ft-- 

ts.o 

16.0 

0.0 

4.0 

16.0 

16.0 

16.0 

0.0 
n  a  — 

16.0 

16.0 

32.0 

6.0 
.  ft  ft 

16.0 

8.0 

0.0 

0.0 

16.0 

O.C 

0.0 

0.0 

«  n 

6  I 

U  •  tf 

0.0 

u  •  u 

16.0 

"Os  9~ 
32.0 

¥•  V 

32.0 

u  *  u 
32.0 

0  .  u 
0.0 

— u  •  u 

0.0 

7  I — 

-~6ii 

8.' 

8.0 

0.3 

8.0 

„  8.8 

0.0 

TABLE  D-3.  (Continued) 


-Si«-t-IST  FREQUENCY  MATRIX  EXAMPLE  PROS  NO-2-.--GJ  X  7A,MGOMPl.£T£*NULT  HEIGHTS*  STM  COMPLETION 


JUDGE  5 

-PRG-J- 

1 

4  > 

2 

1  >  z 

3 

>  l 

A 

in  i 

ii 

7  > 

A 

O 

—  11 

0.0 

0.0 

0.0 

0.0 

.5 

1.0 

1.0 

Z  I 

1.0 

0.0 

0.0 

0.0 

1.0 

1.0 

1.0 

-  3  I 

1  •  V 

1. 

-  •  y 

0.0 

3  *u 

1*0 

1.0 

4  I 

— £  .J 

1*0 

,5 

1*0 

0.0 

0.0 

1.0 
o.a  - 
0.0 

0.0 

0,0 

0.0 

1.0 

1.0 

1.0 

6  I 

0.0 

c.o 

— rrt- 

0.0 

—  X*tT 

0*0 

-  7  I 

y  *  u 

0  • 

*  • 

0.0 

c.o 

1.0 

t  *5 

HEIGHTEO  SU3-LIST  CRE3UENCY  MATRIX  EXAMPLE  PROB  NO  2,  5J  X  7 A* INCOMPLETE  * MULT  HEIGHTS,  SYN  COMPLETION 

-  JUDGE  5 


ROJ  1  2  3  4  5  ~  G - 7 - 

1  I 

0.0 

0.0 

0.0 

0.0 

4.0 

8.0 

8.0 

2  I 

3.0 

0.0 

0.3 

0.0 

8.0 

8.0 

8.0 

3  I 

16.  C 

16. 

o.: 

w  *S 

16.3 

16.0 

16.0 

0  I 

4.0 

4.3 

4.0 

0.0 

4.0 

4.0 

4.0 

-3  1 

2.0 

0.0 

0.0 

0.0 

0.0  - 

- — - - - - - - - - 

6  I 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

T  I 

o.: 

0. 

I.. 

*i  •  C 

V  oU 

4.3 

c.o 
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TABLE  D-3.  (Continued) 


SUMMED  FREQUENCY  MA  TRI X  EXAMPLE  PROB-NO  2t-8B—X- -7A.-I-M;OMPL£-TE»  MULT  HEIGHTS .  SVN  COMPLETION 

-UtfBBE-fMDIfFERENGe  EXISTS  -  -  .  —  -  -  - . 


AOJ  BOROA  ADJ  BORDA 


2  3  4  5  6  7 


36*  0  9.5 

-3.5 
12.0  3.0 


-102.0  -25.5 

-2«4vfl-  71-.  0 

-20.0  -5.0 


1  I  0.0  40.0  48.0  40.0  36.0  43.0.  32.0 

2  I  32.0  0.0  43.0  -  44.3—40.0 — 32.-0— 46-.-0 - — —  - 

3  I  48. j  48. C  C.O  64.0  64. C  32.0  32.0 

— 4-  I- - 16*0-44,6  20.-0 - OtO — 20rO — 42.0 - 6.  6— - 

5  I  18.0  16.0  20.0  16.0  0.0  24.0  24.0 

o  I  64.0  8O.-0  112'.  P.  -  96.0 — 48.0 - 0. 0-  - 48 . 0  — 

7  I  20.0  28.0  28.0  28.0  12.0  24. C  3.0 


ADJ  BOROA---  6  >  1  *■-  3  >  2>-7  5> — <r 
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|  TABLE  D-3.  (Continued) 

► 

[oNPUTED “PREFERENCE  MATRIX  EXAMPLE  PRO0  NO  2,  5J  X  7 A, INCOMPLETE, MULT  HEIGHTS,  S*N  COMPLETION 


'son — 

— - 

1 

2 

3 

4 

5 

6 

7 

-  ow-o- 

-  1t0— 

1-.0 

—8.-6- 

\ 

I 

1*  tj 

•  5 

lTw - 

2*5 

2  I 

0.0 

0.0 

.5 

1.0 

1.0 

0.0 

0.0 

4.0 

3  I 

.5 

.5 

0.0 

1.0 

1.0 

0.0 

two 

-  -  - 

1  1.0 

4  I 

0.  n 

0.  J 

it  •  G 

0.0 

1.0 

o.a 

0.0 

IwO 

5  I 

0.3 

0.0 

0.0 

0.0 

0.8 

0.0 

1.0 

-  -  - 

f  6.0 

6  I 

1.0 

1.0 

1.0 

1.0 

1.0 

0.0 

1.0 

[  2  m  0 

f  I  “ 

1  *U‘ 

0.0 

REF 

6  »  1 

V 

04 

V 

£  > 

7  » 

4  * 

5 

[umber  of  fractional  SUMS=  2 


3HER  M=  T  KENDALL  0  =  2.00  ETA  =  .9571  PROS  THAT  RANK  ORDER  NOT  C0NSI3TANT  =  .0061.T290 

ANK  OROER  CONSISTANT  AT  .05  LEVEL 

ANRORDER - CONSIST  ANT  AT  .01  LEVEL  - 

PPER - N* - 7~~  KENDALL  IT-  - 4r3t - ZETA"  - - t71*-3 - PROD— THAT  RANK  -ORDER  -NOT  CONSISTANT-^-  .03335714- 

INK-ORDER- - COMSISTANT  AT  .05  LEVEL 

ANK  ORDER  NOT  COMSISTANT  AT  .01  LEVEL 


WERA6E  N=  7  KENDALL  O  =  3.00  ZETA  =  .7657  PROB  THAT  RANK  OROER  NOT  CONSISTANT  =  .01726571 


ANK  OROER  CONSISTANT  AT  .05  LEVEL 
INK  OROER  NOT  CONSISTANT  AT  .01  LEVEL 


214 


TABLE  C-3.  (Continued) 


CONCORDANCE  SUHNA^V  gy  ELEMENT  EXAPPLE  PRO8-N0  2,  5J  X  7A,INC0H>L£TE,MULT  HEIGHTS,  S»N  COMPLETION 

UNWEIGHTED  SUBLISTS 


1 

2 

3 

4 

5 

6 

7 

JUDGE 

■»  ^ 

► - - 

-JUDGE 

1 

I 

1.0 

2.0 

3.0 

4.0 

5.0 

6.0 

-7*9 - - - 

JUDGE 

2 

I 

4.0 

2.5 

7.0 

2.5 

6.0 

5.0 

l.C 

JUDGE 

3 

I 

5.5 

5-5 

5.5 

5.5 

1.0 

2.5 

2.5 

JUDGE 

4 

I 

1.0 

3.5 

5.5 

5.5 

7.0 

3.5 

2.0 

JUOGE 

5 

I 

4.5 

3.0 

2.0 

1.0 

4.5 

7.0 

6.0 

RUT 

16.0 

16.5 

23.0 

10.5 

23.5 

24.0- 

■16r5 -  -  -  -  — -  -  -  — 

MEAN  *  20.00  SUM  OF  DEVIATIONS  SQUAREO  =  70.00 


SUN  T  *  7.50 

KENDALLS  COEFICIEMT  O-  CONCORDANCE  =  .166  - H-«-  5 - N  -• — -7 - 

RANK  ORDER  NOT  CONSISTENT  AT  .05  LEVEL.  CRITICAL  S  =  276.26 
RANK  ORDER  HOT  CONSISTENT  AT  .01  LEVEL.  CRITICAL  S  =  343.80 
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I' 


8 
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TABLE  D-3.  (Continued) 


CONCORDANCE  SUMMARY 
UNHEI3HTEO  SUBLISTS 

9*  ELEMENT 

EXAMPLE  PR09  NO 

1 

JUDGE  — ... _ 

2  3  4 

5  6  7 

-ADifiOROA  I  z.o 

4.0  3.0  7.0 

6.0-  1.-9—  5.0  - 

PREF  I  2.0 

4*0  3»  0  6«5 

6.5  1.0  5.0 

2 »  5J  X  7A, INCOMPLETE, HUIT  HEIGHTS*  S*N  C0MPLETI91 


RIJJ  4.)  9. a  6.0  13.5  12.5  2.0  10.0 

MEAN  =  3.00  SUM  OF  OEVIATIONS  SQUARED  =  110.50 


SUN  T  =  .50 

KENOALLS  COEFICIENT  OF  CONCORDANCE  =  .995  9=2  N  =  7 


RANK  OROER  CO'JSISTANT  AT  .05  LEVEL.  CRITICAL  S  =  97.00 

-RANK  ORDER  CO'JSISTANT  AT  .Cl  LEVEfcr-  CRITICAL - 


216 


TABLE  D-3.  (Concluded) 

EXAMPLE  PROS  NO  2,  51  *  7A, INCOMPLETE, MULT  WEIGHTS,  SYN  COMPLETION 
PREFERENCE  RANK  ORDER  SUMMARY 

ELEMENT  INDEX  RANK  ORDER 
-h-* — l  >  3  >  2  >  7*4=5 

RANK  PROJECT 

-  1-  PRO  J  F 

2  P33  J  4 

- 3  p^0J  - 

4  PRO J  3 

PROJ  6 

PROJ  0 

-fr  -  PROJ  E 


2i7 


TABLE  D-4 


tesmnolo 

PLANNING  PRIORITIES 

EXAMPLE  PR 03 

NO  3.  5 J  X  7A. COMPLETE, JUOGE  SELF  EVAL  C  h/O  TM{_0»,HULT  MTS 

nnt=  z 

NPTY?1=  3  NaTYP2=  G 

MATR= 

1  THL0*0«  00 

NPRINT*  0  -  -  -  -  -  —  -  - 

INPUT  PESO  IN  PROJECTS 

INDEX 

ELEMENT  NAME 

NT 

CAT 

1 

PROJ  A 

2. 

0 

2 

PRO  J  3 

2. 

3 

PRO  J  C 

«• 

0 

4 

PRO  J  D 

1. 

0 

5 

PROJ  E 

1. 

0 

6 

PPOJ  F 

4. 

0 

7 

PROJ  G 

■1  • 

3 

G 

ENO 

0. 

0 
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TABLE  D-4.  (Continued) 

-trt"hl  **31  “O  J.  ij  •  «t»  (rtl  1**3  I «i 3* ♦»!*.*  .*s 


x»Js£  :  >:;*(  *  i$£  ik,-;  ■ 

tjf*i  V«4  i.?  .  t  IKJJ  JJ5«  «  s 

i*  ?•  }  *  *  ►  *  »  *  *  r 


.«  .is 


’  jZSti  •  5  kiW  KJCtt  •  s.;  «{  *UJ:  U«!?  ■ 

*4*  *kt  •  7  fc*  t-!S  J(CC(  •  7 

7  *  7  •  .  »  1*  X*  4  »  b  - - -  - 

.;s  •*»  .»  .?>  t.:;  .!* 


S  •  3  *ft!S*«T  •  *.S  /sc  »*ty‘  CI^IT  * 

T3f«i  W  ttf  «  7  m.  tHJS  JJZtl  •  2 


- 2-*  -*  *  •  T'  *  -t  »  2  — 


1.22  .75  i.U  1.2$  .75  l.SJ  -*f 


JJ3i€  *  jCO»r  •  S  JJTC4  JEXC8t  •  JSC  Mtut  tX*IT  • 

tSftt  «4  *S.f  ■  7  M  ft* JS  JUvCC  ■  4 


.  •  7  »  !-•- 


•  U  .52  .79  1.22  1.82  .St  .82 


J333C  5  JCJ*#  »  8  W5Cf  8*154?  *  2.2  Tfi  TIUI  *.Wt  ■ 

T3TM,  7  4*  »i«IS  -XJUl  *  S 

»  1  7*  s  •  8*  ?*♦ 

l.tfi  1.2S  .4=  1.22  .72  *82  2*32 
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TABLE  D-*4.  (Continued) 


SV3-LIST 

JJ3CE  1 

F*£QyE*S* 

X  >  2  »  3 

»  4 

>  s  > 

6  » 

C^AWPlE  P»C9  KC  3.  SJ  *  7*#CO***L£T€. JU3SC 

7 

*>*3j 

1 

2  1 

4 

*> 

6 

7 

.... 

1  I 

1 .  i  .  j 

l.C 

l.C 

l.C 

1.3 

^  i 

3.3 

3.:  1.3 

1.8 

1.6 

l.C 

1.3 

3  I 

O.C 

2.^  3.3 

:.c 

1*2 

1.3 

1.8 

V  I 

3*C 

C.5  3.3 

r.c 

1-C 

1.0 

1*2 

?  I 

«... 

•  •  •  • 

-  *t 

... 

l.C 

*  I 

3.8 

3.?  3.3 

a.c 

2.5 

3.3 

1.9 

r  l 

3.3 

3.3  5.3 

0.3 

r.s 

8.3 

a.c 

SUfi-UST  SELF  FS£S*J£wCT 

•WSE  1  I  »  2  *  *>4»S»6»? 


*0J 

1 

Z 

3 

* 

s 

6 

y 

1 

1 

3...“ 

.2 

.25 

.20 

.20 

.29 

.29 

z 

1 

3.33 

e.o: 

.43 

-SC 

•  90 

•  98 

.48 

3 

i 

3.  S3 

C.83 

3.92 

.48 

.40 

.43 

.49 

4 

I 

3. S3 

o.s;- 

0.C3 

O.dfi 

.68 

.68 

.60 

* 

I 

*  ... 

#  * « 

... 

3.K 

e.2  » 

.21 

.2L 

3 

I 

3.00 

3.  33 

3.33 

3.83 

3.83 

a.cs 

1.8C 

T 

Z 

3. 33 

0.03 

0.33 

9.  iC 

C.C3 

0.38 

s.cr 

£*i^©Le  9909  HO  3.  5J  f.  7A»CG*Px.£T€.,JUO££  SELF  CV*L  ««/«  •  K.&t.'U.T 


*»£ISHT£C  SU9-LIST  -*EVJE»CT  MATRIX 
J'J06£  1 


**0J 

1 

2 

3 


3.3 

3.0 

8*3 

<«* 

3.3 

8.3 


9.3 

C.3 


3.3 

0*3 


l.t 

6.4 

j.C 
-  -i. 
3.6 
3.8 


5l**s»L£  **C3  *C  3.  Si  X  71.C<W.£T£.JU0S£  SEU  f **L  ?«/}  T*aOl.4i*T  «TS 


6 

».€  1*6  l.t 

6.4  6  •  i  £.4 

©.4  6.L 

2.%  2.4 

s.3  .3  *9 

3.3  8.3  19.8 

8.3  8.9  8.S 
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TABLE  D-4.  (Continued) 


SUB-LIST  FREQUENCY  “UTS!*  EXAMPLE  PP08  NC  3*  5J  X  7A  .COMPLETE* JUOGF  SELF  EVAL  (M/0  TmLCT.MULT  MTS 


JUDGE  c  7  *  2  *  4  >  3*  l>  6»  5 


PROJ 

i 

2 

3 

4 

5 

6 

7 

i  I 

0,. 

c  • 

.9 

0.0 

1.0 

1.0 

0.0 

2  I 

l.C 

0.0 

1.0 

.5 

1.0 

1.0 

0.0 

3  I 

.5 

0.3 

0.0 

0.0 

1.0 

1.0 

0.0 

4  1 

1.0 

.  9 

1.3 

o.c 

1.0 

1.0 

0.0 

>  I 

U  •(. 

«•  • 

,  .  ■ 

..c 

C  »i 

J  .0 

v  «  V 

b  l 

0.0 

0.3 

0.3 

3.0 

1.0 

9.0 

0.0 

r  i 

1.0 

1.3 

1.3 

1.0 

1.0 

1.0 

0.0 

SUB-LIST  SELF  EVALUATION  FREQUENCY  MATRIX  EXAHPLF  P*09  NO  5J  X  7A .COMPLETE* JUDGE  SELF  EVAL  (M/C  TMLO)*MULT  MTS 
JUDGE  Z  7  >  2  '  4  >  Js  i>  6  >  5 


PRO  J 

l 

2 

3 

4 

5 

6 

7 

1  I 

0.00 

0.03 

•  13 

9.00 

.20 

•  20 

0.00 

2  I 

•  40 

0.00 

.40 

.20 

•  40 

•  40 

0.00 

3  1 

•  20 

0.03 

0.00 

0.00 

•  40 

.40 

0.00 

♦  I 

.40 

*20 

.43 

0.00 

.40 

•  40 

0.00 

$  l 

2.3l 

•S 

m  .  * 

o.: 

v.Ct 

0  .u- 

0.00 

0.00 

6  I 

9.00 

0.00 

0.00 

0.  00 

x.OQ 

0.00 

0.00 

7  1 

.00 

•  sc 

.33 

•  90 

.00 

•  00 

0.00 

WEIGHTED  SUB-LIST  FREQUENCY  MATRIX  Example  PROB  NO  3*  5J  X  7  A*  COMPLETE  *  JUOGE  SELF  EVAL  <4/0  TMLOI *UULT  MTS 

JUDGE  2 

PROJ  1  2  3  4  5  6  7  . . -- . . . 


1  I 

Z  I 

3  I 

4  I 

5  I 

6  I 


3*2 

3*2 

1*6 

0.0 


J. 

0*3 

0*0 

.3 

0*0 

0.3 


.0 

3.? 

0.3 

1.9 

0.0 

0.3 


1.6 

3.0 

0.0 

0.0 

0.0 


1.6 
3,2 
6.4 
1.6 
0.0 
to.  0 


1.6 
3.2 
6.4 
1.6 
0  *  w 
0.0 


0.0 
0.0 
0.0 
G  .0 
0.0 


%l «. 


\ 


TABLE  D-4.  (Continued) 

SU8-LIST  FREQUENCY  MATRIX  EXAMPLE  PR03  NO  X.  5J  X  X*  .COMPLETE,  JUOGF  SELF  EVAL  (M/0  THLCl.MULT  NTS 


JUOCE  3 

3  > 

'4  S  5 

>  b  * 

7  > 

1  > 

2 

PRO  J 

i 

2 

3 

** 

5 

6 

7 

1  I 

0.0 

i.: 

3.0 

0.3 

0.0 

0.0 

0.0 

2  I 

0.0 

0.0 

0.0 

J.O 

0.0 

0.0 

3.- 

3  Z 

i.: 

i.o 

0.0 

t.o 

1.3 

1.0 

1.0 

V  I 

1.0 

1.0 

0.0 

0.0 

.5 

1.0 

1.0 

5  I 

1.0 

1.0 

0.0 

.5 

0.0 

1.0 

1.0 

6  I 

1.0 

1.0 

0.0 

0.0 

0.3 

0.0 

•  5 

r  : 

1 «  - 

1. 

: . 

.  .1 

l  •« 

.5 

0.0 

SU3-LIST  SELF  EVALUATION  FREQUENCY  MATRIX  £'. AMPLE  PRO  9  NO  3,  5J  X  TA,  COMPLETE,  JUOCE  SELF  EVAL  tN/C  THLO)  .MULT  NTS 


JUDGE 

3 

3  > 

4  =  5 

>  e 

=  7  > 

1  > 

2 

f»ROJ 

1 

2 

3 

•« 

5 

6 

7 

1  I 

0.00 

1.00 

0.00 

0.  bC- 

o.oc 

3.00 

0.00 

2  I 

0.00 

O.OJ 

0.00 

0.  0; 

0.00 

0.00 

0.00 

3  I 

1  .05 

1.0 

3.  . 

1.3; 

l.U 

i  .30 

1.0G 

V  I 

1.00 

1.00 

0.  00 

0.00 

.50 

1.00 

1.00 

3  I 

.75 

.75 

0.  00 

.30 

0.00 

.75 

.75 

6  I 

1.00 

1.  03 

0.  00 

3.  00 

0.00 

0.00 

.50 

r  i 

.53 

.5 

C'.'v 

J .  Jt 

o.cc 

.25 

O.Vu 

NEIGHTEO  SUB-LIST  FREQUENCY  MATRIX  EXAMPLE  PROB  NO  3.  5J  X  TA, COMPLETE. JUOGE  SELF  EVAL  (N/O  THLOI.NUlT  NTS 

JUDGE  3 


PRO  J 

1 

2 

3 

4 

5 

6 

7 

1 

I 

0.0 

32.0 

0.9 

0.0 

0.0 

0.0 

0.0 

2 

I 

0.0 

0  .  u 

j.a 

Q.Q 

0.0 

0.0 

o.o 

3 

1 

54.0 

54.0 

3  . » 

64. C 

6h.  v* 

64.U 

&4.W 

4 

I 

lb.  0 

16.3 

0.9 

0.0 

6.0 

16.0 

16.0 

5 

I 

12.0 

12.9 

9.9 

6.0 

0.0 

12.0 

12.0 

6 

Z 

6**«0 

o4 . 3 

0.0 

0.0 

0.0 

0.0 

32.0 

7 

I 

8.0 

ft.J 

0.0 

0.0 

l  .  4 

4.  t 

V  .  w 

V  .v 


TAELE  D-4.  (Continued) 


5U3-LIST  FRE3UENG*  MATRIX  EXAMPLE  PROS  hO  3,  fj  X  7A •COMPLETE t JUDGE  SELF  EVAt  <W/0  THLC)  .HUL  T  WTS 


JUDGE 

4 

1  > 

7 

►  6 

*  2 

>  3  = 

4  > 

5 

P*OJ 

t 

2 

3 

4 

5 

6 

7 

-  - 

l  I 

Q.3 

1.0 

1.3 

1.0 

1.0 

1.0 

1.0 

2  I 

0.0 

0.2 

1.0 

1.0 

1.0 

.5 

0.0 

3  I 

0.0 

0.3 

0.3 

.  5 

1.0 

0.0 

0.0 

4  I 

0.0 

0.  J 

.5 

3.0 

1.3 

0.0 

0.0 

5  I 

a..- 

l. 

: . 

C  .1 

4.  *4, 

J.o 

0.0 

6  I 

0.0 

.  3 

1.0 

1.0 

1.0 

0.3 

0.3 

r  i 

0.0 

1.0 

1.0 

1.0 

1.0 

1.0 

0.0 

SU8-LI St 

SELF 

eval 

U AT I ON 

FREQUENCE  MATRIX 

EXAMPLE  PW9  NO  3,  5J  X  /A, COMPLETE, JUDGE  SELF  EVAL  IN/O  THLDI.MULT  KlS 

JUDGE 

4 

i  > 

7 

>  6 

*  2 

>  3  * 

4  > 

5 

PROJ 

1 

2 

3 

4 

5 

6 

7 

l 

I 

aUO» 

.6 

.o3 

•  60 

.60 

.60 

.60 

z 

1 

0.00 

0.03 

.SC 

.50 

.50 

.25 

0.00 

3 

I 

0.00 

O.OC 

0.  00 

.35 

.70 

3.00 

0.00 

4 

I 

0.00 

0.03 

*50 

0.00 

1.0  5 

3.00 

0.00 

5 

I 

-  .1'- 

1.3 

j* : 

..:c 

5*0. 

J  .  'JL 

0.0. 

6 

I 

0.00 

•  33 

.so 

.60 

•  60 

0.00 

0.00 

7 

I 

0.00 

.*13 

.*9 

•  AO 

.60 

•  90 

0.00 

WEIGHT EO  SU9--IST  FR63UENCT  MATRIX 


EXAMPLE  PRoe  NC  3,  5J  X  7AtCQMPLETE, JUDGE  SELF  £ tf Al  (W/Q  THLDJ.HULT  WTS 


JUDGE  4 


iOJ 

1 

2 

3 

H 

5 

6 

1 

t 

I 

J.. 

9.5 

9.6 

9.6 

9.6 

9.6 

9.6 

z 

I 

0.0 

0.3 

3.3 

3.C 

6.0 

4.0 

0.0 

3 

I 

0.0 

o.c- 

0.0 

11.2 

22.4 

0.0 

0.0 

4 

I 

0.0 

0.0 

4.0 

0.0 

5.0 

0.0 

0.0 

5 

I 

0.0 

6.5 

0.0 

0.0 

C.O 

g.c 

WAV 

6 

I 

0  *u 

9.5 

19.2 

19*2 

19.2 

0.0 

0.0 

7 

I 

0*0 

b«. 

5.4 

6.4 

6.  4 

6.4 

0.0 
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TABLE  D-4.  (Continued) 


SUB-LIST  FREDUENCf  MATRIX  EXAMPLE  PROS  NO  3 «  5J  X  7 A  .COMPLETE. JUDGE  SELr  EVAL  (W/0  TmLCI.NULT  MTS 


JUDGE  S 

4  > 

3  >  2 

>  1  = 

5  > 

7  > 

6 

P90J 

1 

2 

3 

<4 

5 

6 

7 

1  I 

o.c 

0.0 

0.0 

0.0 

.5 

1.0 

1.0 

2  I 

l.C 

G.i 

0.0 

0.0 

1.0 

l.C 

1  .V 

3  I 

1  •*. 

1.0 

o.o 

0.0 

1.0 

1.0 

1.0 

4  I 

1.0 

1  w 

1.9 

0.0 

1.0 

1.0 

1.0 

5  I 

•  5 

o.c- 

0.0 

0.0 

c.o 

1.0 

1.0 

b  i 

0.9 

3.0 

0.0 

0.0 

0.0 

o.c 

0.0 

7  l 

•  *  - 

‘  • 

*  • 

•  .1 

L  •«. 

1.0 

0.9 

SU3-UST 

self 

evaluation 

FREQUENCY  MATRIX 

tXAKPL;  PROS  NO  3,  5J  X  7A, COMPLETE, JUOGE  SELF  EWl  IN/O  THLOT.NULT  MIS 

JUDGE  5 

4  > 

x  >  Z 

>  Is 

5  > 

7  * 

6 

PROJ 

l 

2 

3 

4 

5 

6 

7 

1 

I 

c.oo 

0.03 

003 

0.00 

•  50 

1.00 

1.  00 

2 

I 

1.00 

0.09 

0.00 

0.00 

1.00 

1.00 

1.00 

3 

I 

.6w 

•  0 

o«:< 

0  .uc 

.Ok 

•  so 

•  so 

4 

I 

1.00 

1.09 

1.00 

0.00 

1.09 

1.00 

1.00 

z 

I 

•  10 

0.03 

0.00 

o.oc 

0.00 

.20 

.20 

D 

I 

0.00 

0.03 

0.  CO 

0.00 

o.oc 

0.00 

0.00 

7 

I 

O.Ou 

9.0 

O.J 

C.3L 

C.  3. 

t.v.* 

3.0-- 

HEIGHT 

JUOGE 

ED  SUB- 

5 

LIST 

frequency 

MATRIX 

EXAMPLE  PROS  NO  3,  53  X  7A, COMPLETE. JUOGE  SELF  EVAL  CN/O  THLOI .“ULT  MTS 

PRD  J 

1 

2 

3 

4 

5 

6 

* 

1  I 

0.0 

0.9 

0.3 

0.0 

4.0 

8.0 

e.o 

2  I 

s.o 

C.O 

0.9 

O.C 

e.o 

9.0 

9.0 

3  I 

12.8 

12.9 

%  # 

12.  S 

12.6 

12.6 

*  I 

-*.0 

4.3 

4.0  . 

0.0 

4.0 

4.0 

4.0 

5  I 

•  4 

0.9 

0*0 

0.0 

0.0 

*6 

•  s 

5  I 

0.0 

0.0 

0.0 

0.0 

c.o 

0.0 

0.0 

7  1 

0.0 

0.0 

0.0 

0.0 

0.0 

4.0 

u. 0 

‘W'i 


TABLE  D-4.  (Continued) 


■JH4E0  FREQUENCY  MATRIX  EXAMPLE  PROS  NO  3,  5J  X  7A.CCNPLET c» JUDGE  SELF  EVAL  (W/O  t HL 0)  »HULT 

JUDGE  INDIFFERENCE  EXISTS 
EQUIV 


IQJ  BOROA 

ADJ 

BO’DA 

- 

3 

u 

6 

6 

7 

-77.2 

-19.3 

l 

I 

0.0 

43.2 

12.0 

11.2 

.  16.c 

20.6 

19.2 

-137.6 

-34.1, 

2 

I 

11.2 

0.0 

17.6 

16.0 

25.6 

21.6 

14.4 

>55.  2 

113.3 

3 

I 

3,  #  * 

76  »6 

C.O 

81*  6 

112.- 

69.6 

83.2 

—21,-2 

-5.3 

I 

21.6 

20.6 

9.6 

0.0 

24.0 

24.0 

22.4 

-165.6 

-4 1.4 

5 

I 

12.4 

12.0 

0.0 

6.  0 

0.0 

13.6 

13.6 

-  72.0 

18.0 

6 

I 

6  0 

73.6 

19.2 

19.2 

35.2 

0.0 

43.  0 

-125.6 

-31.4 

7 

I 

11.2 

17.6 

9.6 

9.6 

9.6 

17.6 

0.0 

I-  09RDA 


3  >  5  >  4  >  1>  7  >  2  >  5 


TABLE  D-4.  (Continued) 


COMPUTEO  PREFEREN'E  MATRIX  EXAMPLE  PROB  NO  5,  5J  X  7A, COMPLETE. JUOSE  SELC  EVAL  (W/O  ThLOI.MULT  H 

SUM  12  3  4  5  6  7 


- 3;0-  •  1  I  0.0  1.0  0.0  0.0  1.0  0.0  1.0 

1.0  2  I  0.0  0.0  0.0  0.0  1.0  0.0  0.0 

6.0  3  I  1.0  1.0  0.0  1.0  1.0  1.0  1.0 

5.0  4  I  1.)  1.0  O.J  C.e  1.2  l.C  1.0 

1.0  5  I  0.0  0.0  O.C  0.0  0.0  0.0  1.0 

4.0  6  I  1.0  1.0  0.0  0.0  1.0  0.0  1.0 

- tvo - 7  I  0.0  1.0  0.3  0.0  0.0  0.0  0.0 


PREF  3  »  4  >  6  >  1>  5=  2=  7 

NUMBER  OF  FRACTIONAL  SUMS=  0 

N=  7  KENDALL  0  =  1.C0  ZETA  =  .9286  PROB  THAT  RANK  ORDER  NOT  CONSISTANT  =  .30202-. 

RANK  ORDER  CONSISTANT  AT  .05  LEWEL 

-RANK  ORDER  CONSISTANT  AT  .01  LEVEL 


TABLE  D-4.  (Continued) 


■"  UNWEIGHT^O^SUBl  I  ST  3  ^  ELE,1£NT  ElrtWtE  PHOB-W-3,  ^-X-^*rCOh^LETE„IUOG€  SELF  EVAL  <M/0  THL01.MULT  H 


JUDGE 

1 

2 

3 

4 

5  6 

7  - 

—  — 

_  .  At  in  nr 

JVUUt 

1 

I 

1.3 

2.0 

- G 

- fy#- 

JUDGE 

2 

I 

4.5 

2.5 

4  .5 

2.5 

1.0 

JUDGE 

3 

I 

5.0 

7.0 

1.0 

2.5 

2.5  4.5 

4*5 

JUDGE 

A 

I 

1.0 

3.5 

5.5 

5.5 

7.0  3.5 

2.0 

JUDGE 

5 

I 

•♦•5 

3.0 

2.0 

1.0 

4.5  7.0 

6.0 

— 

R<J* 

17. 

18.0 

16.0 

15.5 

26,8  27.0 

28.5- - 

- - 

MEAN  = 

20 

.  00 

SUM  OF  DEVIATIONS 

SQUAREO  * 

134.50 

SUM  T 

S 

3.50 

KENDALLS  COEFICIENT  OF  CONCORDANCE  *  r!97  ~H-«. — 5 _ 

RANK  OROER  NOT  CONSISTANT  AT  .05  LEVEL.  CRITICAL  S  =  276.28 
RANK  OROER  NOT  CONSISTANT  AT  .01  LEVEL.  CRITICAL  S  =  343.80 
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K 


I' 


k« 


TABLE  D-4.  (Continued) 


^Hfrr2i-nEo»nrr^I  BY  ftL6"ENT  EXAMPLE  PR09  MO  3.  5J  X  7A.COHFLETE.JUOGE  SELF  EVAL  IH/O  TMLOI.NULT 

UNH fclbH i -  u  SUBLISTS 

12  3  4  5  6  7 

judge  - 

10J  BORM'-  I  -  4«0"  6.8  1.8  ~~3. 3  — 7.8 - ?5rO - 5s  8 - - - - — _ _ 

PREF  I  4.3  o.u  i.C  2.0  6.0  3.C  6.0 


RCJ) 

8.3 

12.0  2.0  5.0  13.0  5.0  11.0 

MEAN  = 

8.00 

SUM  OF  DEVIATIONS  SQUAREO  =  104.00 

SUM  T  = 

2.08 

KENDALLS 

COEFICIENT 

O-  CONCORDANCE  =  .963  M  =  2 

N  *  7 

RANK  ORCER  COVSISTANT  AT  .05  LEVEL.  CRITICAL  S  =  97. CO 
RANK  ORDER  MOT  COmSISTAMT  AT  .01  LEVEfcs-CRITICAL  5  ■ — tOVrflR 
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*a>r. 
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TABLE  D-4.  (Concluded) 

EXAMPLE  PR09  NO  3,  5J  X -?AfG0MPL£TE, JUDGE  SELF  £VAL  <H/0  TMLOI.NULT  «TS 
PREFERENCE  RANK  OBOES  SUMMARY 


c 


k> 


TABLE  D-5. 


TECHNOLOGY  PUNNING  PRIORITIES  example  PRCli  NO  4,  SJ  X7A,  COMPLETE, JUUGE  SELF  EVALT40*  THLO>  ,NULT  NTS 


NMT-=  2  -NPTYPl=  8  N°TYP2=  fc 


MATR=  2  --THLU*— .•< 


INPUT  READ  IN  PROJECTS 


INDEX 

■  ELEMENT  NAME 

NT 

- -CAT- - 

1 

PROJ  A 

2. 

0 

2 

proj  a 

2. 

0 

3 

PROJ  c 

<•>. 

0 

*, 

PROJ  D 

4 

3 

5 

PROJ  E 

1. 

■a—  — 

6 

PROJ  F 

4. 

0 

7 

PROJ  G 

1. 

0 

a 

END 

0. 

0 
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TABLE  D-5.  (Continued) 

£<*MP IE  S3  4,  Sj  *7A#  COMPETE* JUDGE  SEL*  EV*Lt«.3*  T*.L3»***litT  MTS 

JJD-E  1  JCO'I*  *  C  JUDGE  mEIChT  *  2.3  j$t  Y^LUE  L  ImIT 

TOTAL  H9?  ALT  *7  N3  IMIS  JUDGE  *  I 

l»  ?»  J>  **  5*  G»  7 

•  23  .40  .«0  .6C  .20  1*35  .O 

JJDGE  2  JCOSY  «  0  JUDGE  HEIGHT  =  X.8 

TDUl  N0»  ALT  *  7  HU  THIS  JUDGE  *  2 

M  ?  t  4  ►  J  .  «  >  6  >  5 

•20  *49  •• 3  *40  -20  i.lfJ 

JUDGE  3  JC3YY  «  0  JUDGE  HEIGHT  *  4.0  JSE  VALUE  LIMIT 

TOTAL  MB*  ALT  •  7  H*  THIS  JUOGE  *  3 

3  -*--4  •  5  »  6  *  7  »  I  ►  2  —  —  — 

1.90  .75  1.90  1.60  .7$  1.00  .S3 

JUDGE  4  JCOYV  *  0  JUDGE  HEIGHT  *  2*0  JSC  VALUE  LIMIT 

T3T4L  Nft*  ALT  «  7  M  THIS  JUDGE  •  4 

- - 1  *  7  >  6  ■  2»  J  ■  A  >  f  ■■-- 

•St  .58  .78  t.lt  1.81  .68  .93 


J$E  ¥ALUE  LIMIT 


.43 
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TABLE  D-5.  (Continued) 


jjdge  5  jccm  =  '0  judge  weight  =  1.0  jse  valje  li*«it  =  = 

T3TAL  NBR  ALT  =  7  tC?  THIS  JUDGE  a  S 

■»  *  3  *  2  >  1  *  1  »  7  »  6  - - -  - — 

l.oo  l.oc  .oo  i.;c  .23  .a.  i.eo 


SJ3-LIST  FHEj’JEHEr  *aMIX  EXAMPLE  P«?OB  NO  *,  5J  X7A,  C9"PLETr « JUDGE  SELr  EV4LU3X  THLC),HL1T  . 

JUDGE  1  2>4»6»7 


f-«D 

1 

1 

2 

3 

-  % 

5 

6 - 

- ? - 

1 

1 

3.0 

0.0 

0.3 

0.0 

0.0 

0.0 

0.0 

2 

1 

0.3 

3.1 

0.0 

1.0 

0.0 

1.0 

1.0 

3 

1 

J  *  k 

L  • 

j  •  . 

^  .0 

k  *U 

O.C 

0.0 

*T 

1 

0.0 

0.3 

0.3 

0.0 

0.0 

1.0 

1.0 

5 

1 

0.0 

0.0 

0.0 

9.0 

— «.  o 

-0.8 

0.0 

1 

3.0 

0.1 

0.3 

3.0 

0*0 

0.0 

1.0 

7 

1 

j  *» 

0. 

A 

^  • 

..t 

3.0 

1.  »i 

*>t* r. 


TABLE  D— 5.  (Continued) 


-SUB-LIST  SELF  EVALUATION  FREQUENCY  MATRIX 


EXAMPLE  FROB  wo  4,  5J  *7A,  COMPLETE , JUDGE  SELF  EVAL  1407.  THLOUNUL 


-JUDGE  1 

2  » 

*.  *  6 

>  7 

*  0  > 

0  > 

0 

REDUCED 

MATRIX 

- 

— 

PR3J 

1 

2 

T 

4 

5 

6 

7 

t  I 

j*'«. 

J  •  0 

r 

w  •  - 

l»  •  JC 

l  •  w  . 

C.GO 

0.0- 

- 2  I- ■ 

0.03 

0.93 

0.09 

.30 

0.49 

”  »  89 - — 

3  I 

0.00 

0.  03 

0.03 

0.00 

0.00 

0.00 

0.00 

- *  I 

0.00 

0.03 

0.09 

0.00 

0.00 

.60 

.60 

5  I 

0.00 

n.  03 

0.00 

0.  00 

0.00 

0. 04 

C*v« 

- fr"|^ 

3.3i 

0.  00 

0.03 

0.00 

0.30 

0.09 

1.00 

7  I 

0.00 

0.0) 

0.00 

0.00 

0.03 

0.00 

0.00 

WEIGHTED  SU3-L 

1ST  i 

”ErJE*Cr-MATRIX 

EXAMPLE  PROB  NO  4,  1 

— JUDGE  : 

l 

PROJ 

* 

« 

2 

T 

*» 

5 

6 

7  - 

—  1  I 

J*. 

*i  • 

v  • 

c.c 

4  •  • 

0.3 

C  .C 

2  I 

0.0 

0.0 

0.3 

6.4 

0.0 

6*4 

6*4 

3  I 

0.0 

0.0 

0.0 

0.0 

0.  0 

0.0 

0.3 

<•  I 

0.0 

0.  j 

0.3 

0.0 

0.0 

2.4 

2.4 

-  5  I 

0.0 

0.3 

0.0 

8.C 

■Oifl 

o.e- 

xr*u 

5  I 

•  * 

3.3 

0.9 

0.0 

0.0 

0.0 

16.0 

7  I 

0.0 

0.0 

3.0 

0.0 

0.3 

0.0 

0.0 

COMPLETE, JUDGE  SELF  EVAL  <407  THim.MULT  RTS 
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TABLE  D-5.  (Continued) 


SU9-UST  f*E3JE«<C*  *«ATPIx 


€KAMPi£  MOD  *C  SJ  *79.  COMtnC.JUDGE  SEt-  EVAL CL8T  TMiCl.XULT  *TS 


JUDGE  2  S  >  5 


1 

2 

3 

♦ 

5 

G- 

-  - 

•  1  I 

3.3 

0.3 

0.0 

9.9 

9.0 

0.0 

0.9 

Z  l 

3.3 

3.9 

8.3 

3.8 

0.9 

9.8 

£.C 

3  I 

(.•«. 

a. 3 

9.3 

U.C 

9.9 

0.9 

0.9 

»  I 

9.0 

0.9 

9.3 

9.C 

0.3 

9.0 

0.0 

5  I 

:.9 

C.O 

3.3 

i.9 

0*0 

O.fi 

3.0  ------ 

b  I 

3.0 

O.S 

0.3 

9.8 

1.) 

1.0 

a.c 

7  I 

5.? 

3. 

••  * 

.  .c 

.  ♦. 

v.o 

9.0 

SJS-USI 

S£l"  E»»UiS 

TID-4 

M£5U£KCY  -lAtRlx 

SXA**L£  PP08  **0  G.  SJ  *7*.  C08PL Etc, JUDGE  SELF  tUiU»  f19>,*tJlT  «TS 

JtJDCE  7 

*£3u«0 

-.AT*lX 

9  >  5 

>  c 

>  C  = 

8  * 

o  > 

0 

MOJ 

t 

2 

3 

H 

5 

6 

7 

1  X 

3*3 

3. ’9 

9.96 

3.30 

8.90 

9.CG 

2  I 

3.09 

9.93 

6.93 

9.00 

9.96 

9.10 

9.98 

3  I 

3. CO 

9.93 

9.93 

0.90 

3.89 

0*90 

0.03 

%  X 

o.ec 

0.93 

0.09 

3.99 

8.  08 

9.99 

9.99 

5  I 

3.8. 

i.S 

3.1 

.  •  3C 

t.C^ 

3.31 

«.<  i 

9  I 

0.69 

3.3: 

0.C9 

9.  6C 

1.99 

0.99 

6.08 

7  1 

3.36 

0.03 

6.85 

•«36 

G.93 

e.M 

9.00 

^ICiTED  SUB-LIST  *p£Q*JEkC7  *AT$I* 


EiAMLE  *>6GB  *C  *,  5J  X7A.  CO*fPtET£,JUOGC  SELF  EvALfti?  T»*L?I  **?ULT  «TS 


JUDGE  Z 


WJ 

1 

2 

X 

* 

5 

6 

7 

1  1 

9.9 

9.9 

9. 

..0 

o.c 

t  .6 

*  I 

8.9 

0.3 

3.9 

3.9 

9.9 

9.9 

9.9 

3  i 

9.9 

3.3 

0.9 

8.6 

9.9 

9.9 

9.9 

4  X 

0.9 

6.3 

0.9 

3.8 

C.9 

0.0 

0.9 

9  2 

9.6 

6.3 

8.9 

6.9 

«•« 

9.9 

9.9 

b  t 

i*. 

;  , 

“  .  . 

.  .8 

1 6.. 

«.e 

9.9 

7  I 

9.6 

0.9 

8.6 

6.4 

•  •• 

9.9 

0.8 
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TABLE  D-5.  (Continued) 


sub-list  freouenc*  matrix  example  pros  no  ...  sj  xta,  cohplf»£, juogl  selc  evaliuox  tmloi.nuit  k»s 

JUDGE  3  3>Ws5>fes7>i>3 

P*OJ  12  5  4  5  6  7 

1  :  o*o  1.0  o.o  o.c  o.o  o.o  o.o 

2  I  O.o  0.0  0.0  0.0  0.0  0.0  ..9 

II  I»f  l.o  O.o  1.0  1.0  1.0  1.0 

<>  I  1.0  1,3  0.0  0.0  .5  1.0  1.0 

■••  5  1  1.0  1.0  0.  0  .5  0.0  1.0  1.0 

5  I  1.0  1.9  0.0  O.C  0.0  0.0  .5 

r  i  i.:  i.  :.  j.c  o.o  .5  o.o 


-SU3-LI5T  SELr  EVALUATION  FREQUENCY  NATNIX  EXAMPLE  PROB  NO  A,  5J  X7A  .  COMPLETE . JUD3E  SELF  EVALUOX  THLO)  .MULT  NTS 

--JUOGE  3  3>4»5>E»7>1>2 

•-RE-WCEO  MATRIX  - -  - 


PROJ  1  2  3  4  5  6  r 


l  I  0.0.  l.C  O.C  0*01  4.0.  O.L'Q  C.Oo 

-  !  I  0.00  0.00  0.  00  0.00  0.00  0. 00— 0.00 

3  I  1.00  1.00  0.  00  1.00  1.00  1.00  1.00 

4  I  1.00  1.00  0.00  0.00  .50  1.00  1.00 

5  I  .75  .75  0.00  .30  0.00  .75  .75 

-5  £  1.00  1.01  0.00  0.00  0.00  0.00  >50 

7  I  .50  .50  0.00  0.00  0.00  .25  0.00 


WEIGHTED  SUB-LIST  FREQUENCY  MATRIX  EXAMPLE  PROB  NO  4,  5J  X7A,  COMPLETE  .JUDGE  SELF  EVALI40X  fNLO» .MULT  MTS 

JUOGE  3 


PROJ 

1 

2 

3 

4 

5 

6 

7 

1 

I 

o.c 

32.3 

o.: 

.  *  l> 

C.J 

c .  c 

c.c 

2 

I 

0.0 

0.0 

0.0 

O.C 

0.0 

0.0 

0.0 

3 

X 

54.0 

54.0 

0.0 

64.0 

64.0 

64.0 

64.0 

4 

I 

16.0* 

16.0 

0.0 

0.0 

6.0 

16.0 

16.0 

5 

I 

12.0 

12.0 

0.0 

6.0 

0.0 

12.0 

12.0 

6 

X 

54*. 

64. 

3.; 

i  *0 

0.0 

32.0 

7 

X 

0.0 

8.3 

0.0 

0.0 

0.0 

4.0 

0.0 
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TABLE  D-5.  (Continued) 


SU9-LIST  FRE1UENCT  941!!!*  EXAMPLE  PROS  X.U4.  SJ  X?*,  COMPLETE, JUOGE  SELF  EVAlU.01  TNLOI.NUIT  MTS 

JUDGE  9  1  >  ?  >  6=  2  >  3  a  h  >  5 

PROJ  1  2  3  9  5.  6  7 


t  I  0-0  1.0  1.3  1.0  1.0  1.0  1.0 

E  I  0.0  0.0  1.5  t.C  1.0  .5  -.3 

3  1  0.3  .  .0  0.5  .5  1.0  0.0  0.0 

♦  I  0.0  C.C  .5  2.0  1.0  0.0  0.0 

5  I  0.0  0.!  3.0  0.0  0.0  0.0  0.0 

6  I  0.0  .3  1.0  l.C  1.0  0.0  0.0 

E  I  ...  1.  1.  1.3  I*.  l.C  0.0 


SUB-LIST  SELF  EVALUATION  FRcOLENCV  RAT  R IX  cXANPLl  PROS  NO  *t «  5J  X7A,  CONPLETE,  JUOGE  S£LF  EVALT40X  THLO )  .  NULT  MTS 
JUOGE  4  1>  7  >  G  =  2  *  3=  4  >  5 

RE3UCEO  MATRIX 


PPOJ 

l 

? 

3 

4 

5 

6 

7 

l  I 

•  6 

.  b 

.  61 

•  6c 

•  6C 

.61 

2  t 

0.00 

0*0; 

•  51 

.50 

.50 

•  25 

0.00 

3  I 

0.00 

o.o; 

0.  00 

♦  35 

•  TO 

3.  SC 

0.09 

4  I 

0.00 

0.0'.' 

.53 

0. 30 

1. 00 

0.00 

0.00 

5  I 

0.30 

o.o: 

0.00 

G.OC 

0*00 

0.JC 

w  «0C 

6  I 

.  .CO 

.3) 

.51 

.60 

•  60 

0.00 

0.30 

7  l 

0.00 

.  45 

•  33 

.30 

•  60 

.60 

0.00 

MEIGHTEO  SUB-LIST  FRE9UENC*  MATRIX  EXAMPLE  PROS  NO  4,  SJ  X7A,  COMPLETE, JUOGE  SELF  EVALT40X  TMLOI.NULT  MTS 

JUOGE  4 


P*DJ 

1 

2 

3 

4 

5 

6 - 

7 

1  I 

0.0 

9.5 

9.6 

9.6 

9.t» 

9.6 

9.6 

2  I 

0.0 

0.3 

6.0 

d.C 

6.0 

*».o 

0.0 

3  I 

0.0 

0.0 

0.0 

11.2 

22.4 

9.0 

0.0 

4  I 

0.0 

0.9 

4.3 

0.0 

a.o 

0.0 

0.0 

9  X 

0.0 

0.3 

0*3 

0.0 

0.0 

0.0 

0.0 

6  I 

V*. 

9.5 

19.2 

19,2 

19.2 

3.0 

9.0 

7  I 

0.0 

6.u 

6.  ’* 

6.4 

6.  4 

6.4 

0.0 
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TABLE  D-5.  (Continued) 


sub-list 

ERETJENCV 

matrix 

EVA*>IE  PROft  NO  ...  5 J  *7A.  COMPLETE,  JUDGE  SELF 

EVALUOX  THLD),"ULt  MTR 

JUDGE  5 

4  > 

3  >  2 

>  i  >  r  > 

6 

PROJ 

l 

2 

3 

H  5 

6 

7 

1  I 

0.0 

0.0 

0.0 

0.0  0.0 

1.0 

1.0 

2  I 

1.0 

0.0 

0.9 

0.0  0.0 

1.0 

1.0 

3  I 

1.  2 

1. 

. . : 

v.t  u*. 

i.c 

1.0 

4  I 

1.0 

1.0 

1.0 

0.0  0.0 

1.0 

1.0 

5  I 

0.0 

0.0 

9.0 

O.C  0.0 

0.0 

0.0 

0  I 

0.0 

0.0 

0,0 

9.C  0.0 

0.0 

0.0 

7  I 

w  *- 

0. 

*  * 

.  .  w  .  u 

1.0 

O.C 

-sub-list 

Stir 

Evaluation  vrequencv  matrix 

example  pros  no  m,  sj  xza,  complete,  judge  sel* 

evsL usx  moi.NJEt  wr 

JUDGE  5 

h  > 

3  >•  2 

A 

A* 

A 

A 

6  > 

0 

REOUCEO  NAiSXX 


PRO-1  1  2  3  X  5  6  7 


1 

l 

3 . £u 

0.9 

O.C* 

90 

0.00 

1.00 

1.00 

l 

l 

1.00 

0.00 

0.00 

0.00 

0.00 

1.00 

1.00 

3 

I 

.00 

•  43 

0.00 

0.00 

0.00 

.40 

.40 

4 

I 

1.00 

1.0) 

1.  09 

0.00 

o.oo 

1.00 

1.00 

5 

I 

:.cu 

9.0 

o. : 

;  • ;  z 

w  ••  . 

3  . «l 

J  .44 

-  6 

I 

0.00 

0.03 

0.00 

0.00 

0.00 

0.00 

0.00 

7 

I 

0.00 

0.03 

0.  00 

0.00 

0.00 

1.00 

0.00 

ME1GHTEO 

sua- 

■LIST 

FREQUENC* 

MATRIX 

EXAMPLE  PROS  NO  4,  5J  X7A,  COMPLETE*  JUDGE  SELF  EVALU5X  T^LOI  .KULT  NT S 

JUDGE  5 

POJ 

l 

2 

3 

H 

5 

fi 

7 

1  I 

O.C 

0.0 

o. : 

.  «v 

t«v 

9.C 

s.c 

2  X 

4.0 

0.3 

0.0 

0.0 

0.9 

4.9 

4.0 

3  I 

12.9 

12. -j 

0.0 

0.0 

0.0 

12.4 

12.0 

4  I 

-..0 

4.0 

4.0 

O.C 

0.9 

4.  0 

3  I 

0.0 

0.3 

9.9 

0.0 

0.0 

0.0 

O.fl 

&  I 

3.. 

u. 

l  « 

.  .4 

l*. 

0.0 

0.0 

7  I 

0.0 

O.C 

0.0 

0.0 

0.0 

4.0 

v.  0 
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TABLE  D-5.  (Continued) 


5tf««E0  FREQUENCY  4ATRIX  EXAMPLE  PR09  NO  4,  5J  X7A,  COMPLETE, JUDGE  SELF 

JJOGE  INDIFFERENCE  EXISTS 


— EQUI X 
AOJ  BORDA 

AOJ 

eOROA 

1 

2 

3 

4 

6 

6 

7 

-93.2 

-20.9 

1 

I 

0.0 

41.6 

9.6 

9.6 

9.6 

17.6 

17.6 

-167.2 

-41.8 

2 

I 

8  • 

0.0 

6.0 

14.4 

8.0 

18.4 

14.4 

417.6 

104.4 

J 

I 

76.8 

76.6 

0.0 

75.2 

86.4 

76.6 

76.  8 

—22.  O 

4 

I 

20.8 

-  4.8 

16.0 

22.4 

22.4 

-107.6 

-26.9 

5 

I 

12.0 

12.0 

0.0 

6.  0 

0.0 

12.  0 

12.  0 

97.6 

24.4 

6 

I 

64,  j 

73.6 

19.2 

19.2 

35.2 

0.0 

48.  0 

-135.2 

-33.3 

7 

I 

8.0 

14.4 

6*4 

6.4 

6*4 

14. 4 

0.0 

A&J  B0R04 


3  >  6  >  4  »  1  >  -  S  >  7-  >  ? 


t?-*l 


TABLE  D-5.  (Continued) 


computes  preferen:! 

SUH  1  ? 

3 

4 

5 

EXAMPLE  PROP 

5  7 

NO  u,  5 J 

2.-  1 

I 

*»  i 
j  •  . 

i  •  . 

.  .0 

0.0 

0.  0 

0.1 

t.O 

•  5  2 

I 

0.0 

3.0 

0.0 

0.0 

0.0 

0.0 

.5 

5.0  3 

I 

1.0 

1.0 

0.0 

1.0 

1.0 

1.0 

1.0 

5.0  <♦ 

I 

1.0 

1.0 

0.0 

0.0 

1.0 

1.0 

1.0 

3.:  5 

I 

i.: 

1 .. 

-  •  u 

l  t  b 

•3.. 

o  •  C 

1«  b 

u  6 

I 

1.0 

1.0 

3.0 

0.0 

1.0 

0.0 

l.C 

.5  7 

1 

0.0 

.5 

0.0 

0.0 

a.  o 

0.0 

0.0 

PREF 

3  > 

>  6  > 

5  > 

1  > 

2=7 

NUMBER  O'  F RAC 

TIONAL 

SJNS  = 

2 

LOWER 

N= 

7 

KENDALL  C  = 

0.00 

ZE 

r  £  = 

1.0000 

RANK  ORDER 

CONSISTANT  AT 

..5 

LEVEL 

RANK  ORDER 

consi: 

STANT  AT 

.01 

LEVEL 

UPPER 

Ms 

7 

KENOALL  0  = 

0.  00 

ZETA  = 

1.0000 

RANK  ORDER 

CONSISTANT  AT 

.05 

LEVEL 

RANK  OROES 

CONSIST  ANT  AT 

.01 

LEVEL 

AVER# 3E 

NJ  = 

7 

KENDALL  0  = 

0.00 

ZETA  = 

1.0000 

RANK  ORDER 

CONSI 

SCANT  AT 

.05 

LEVEL 

RANK  ORDER 

CONSISTANT  AT 

•  wl 

level 

1.0000  PfiOB  THAT  RA NK  ORDER  NOT  CONSISTANT  =  O.OOOOC 


1.0008  — TMfOB  THAT  RANK  OROEP  NOT  CONSXSTANT  =  0.00800 


1.0000  PROB  THAT  RANK  ORDER  NOT  CONSISTANT  =  O.OOOOC 
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TABLE  D-5.  {Continued) 


CONCORDANCE  SUMlft^r  9V  EUE1ENT  EXAMPLE  ORDJ  f.  ) 

UNWEIGHTED  SU3LISTS 

1  ?  3  4  5  6  7 


JUOGE 

- - 

■  — 

JUDGE 

1 

I 

6*  G 

1.0 

6  •  G 

2.0 

6.0 

3.0 

4.  0 

JUOGE 

C 

I 

5,  4 

'  •  » 

5.. 

5 

2 . . 

1  *  w 

5  •  j 

JUOGE 

3 

I 

6.0 

7.0 

1.0 

2*5 

2.5 

4.5 

4.5 

JUOGE 

4 

I 

1.0 

3.5 

5.5 

5.5 

7.0 

3.5 

2.  0 

JUOGE 

5 

I 

•*.0 

3.0 

2.0 

1.0 

7.0 

6.0 

5.0 

J* 

22.0 

19.5  19 

•  5 

16.0 

2-.  5 

1  o  •  0 

20.5 

MEAN  = 

20. 

00 

SUM  OF 

DEVIATIONS 

SQUAREC  = 

«*5 

SUM  T 

= 

14 

.  00 

?J  tt  A,  '-OHPtETf  .JUOGE  SELF  E/AL<4u*/.  TmlOI.MULT  WTS 


KENOALLS  COEFIJ I  ENT  0=-  CONCORDANCE  =  .-C71  M  =  5  N  =  7 

RANK  OROER  NOT  C0NSIST4NT  A T  .05  LEVEL.  CRITICAL  S  =  276.20 
RANK  OROER  NOT  CONSIST  ANT  AT  ..l  LEVEL.  CRITICAL  S  =  343.00 


240 


TABLE  D-5.  (Continued) 


CONCORDANCE  SUMMARY  BY  ELEMENT  EXAMPLE  PR09  NO  A*  5J  X7A«  COMPLETE. JUDGE  SELF  EV*L(40 *  THL0),HULT 

UNWEIGHTED  SUBLISTS 


1 

,  ? 

3 

4 

5 

6 

7 

JJjbc.  “  — " 

&D J  03RDA  I 

4.  0 

7.0 

1.0 

3.0 

5.0 

2.0 

6.3 

PREF  I 

5.0 

5.5 

1.0 

2.0 

4.0 

3.0 

6.5 

■R(  J) 

9.0 

13.3 

2.u 

5.: 

9.0 

5.3 

12.5 

M£  AN  =  3.00  SUN  OF  DEVIATIONS  SQUARED  =  106.50 

SUM  T  -  .50 

KENDALLS  COEFICIE'.T  OF  CONCORDANCE  =  .959  M  =  2  N  *  7 

RANK  ORDER  CONSISTANT  AT  .05  LEVEL.  CRITICAL  S  =  97.00 

RANK  OROER  CONSISTANT  AT  .01  LEVEL.  CRITICAL  S  =  104.00-  - 
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TABLE  D-5.  (Concluded) 


EXAMPLE  PROS  *40  ** ,  5  J  X7A,  COMPLETE,  JUDGE  SELP  EVAlU.X  T **L 'll  «  4UL  T  ms 


PREFERENCE  rank  ORDER  SUMNAPY 


ELEMENT  INDEX  RANK  qpqER 
5  >  4  >  b  »  5  >  <  >  Z 


PROJECT 


pro  j  : 


2  P-’OJ  D 


5  PRO  I  • 


PRO  J  £ 


PRO  J  A 


PRO  J  B 


P=OJ  5 


TABLE  D-6 


'TECHNOLOGY  PLANNING  PRIORITIES 


-1«NT=  8  «PTYP1=  )  VPTYP?=  0 


INPUT  PEA 0  IN  PROJECTS 


INOEX  ELEMENT  NAME 

1  PES  -01 

2  °E$  -02 

3  PES  -03 

PES  -U4 
PES  -05 
PES  -06 
PES  -07 


EXAMPLE  C»Oi  NO  =>  :j  »74, 


MAT«=  0  THLC=0»  03  NPR I \T=  0 


NT  CAT 

0.  0 

0.  0 

0. 

0.  3 

0.  0 

0.  0 

0.  3 


CONPLETE/N  REQUIREMENTS  TpAnSLAT-ON 


p 

6 

7 


TABLE  D-6.  (Continued) 

-EHAMPLE  =>R06  NO  5  5J  *7A,  COHPlETE/H  REQUIREMENTS^  TRANSLATION  -  - 

l__ 

JUDGE  l  JCOMV  s  3  JUDGE  HEIGHT  =  0.3  JSE  VALUE  LIMIT  =  0 

TOTAL  N8R  ALT  =  7  f.R  THIS  JUOGE  =  1 

- 1  »•  2  »  3  »  * -►  -•=►-» - fr  > — 7  —  - - - - - 

—JUDGE  2  JCOVV  «  0  JUOGE  HEIGHT  r  8.0  JSE  VALUE  LIMIT  »  0 

-TOTAL  N65  alt  *  7  -NR  THIS  JUOGE  - - 2 - - 

7  >  2  =  4  »  3  =  l>  6  »  5 


JUDGE  3  JCOVV  =  .  JUOGE  HEIGHT  =  i.u  JSE  VALUE  LIMIT  »  0 

TOTAL  N3R  ALT  =  7  NR  THIS  JUDGE  =  3 

3  >  4  *  5  »  5  *  7  »  1  >  2  - - - 

JUDGE  4  JCOMV  =  0  JUDGE  HEIGHT  *  0.0  JSE  VALUE  LIMIT  =  « 

TOTAL  -N8R  ALT  •  7  NR  THIS  JUDGE-  * - 4 - - 

t»  7  »  5  =  2  »  3  =  4  »  S 

INPUT  READ  IN  REQJIREMEN 
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TABLE  D-6.  (Continued) 


INDEX — —  ELEMENT  NAME 


NT  CAT- - 


X 

• - «»». 

2 

R301. 

— 

-  <*3=2rSE-A2 

4 

R332.00E2 

- 5- 

—  *385.  ooe 

6 

R3G6. 

- r 

— R401.00A 

8 

R6;i.V38 

Zi  ** 

- RN81.-B8S 

m 

R401.00H 

c. - “ 

— *401.001 

12 

R431.VGK 

6 

~ - *401. 00N 

14 

R6H. 

•  — «- 

'  R6C  V* 

s  16 

R606. 

-  —  END 


s! 


-Or-  - -8- 

0.  0 

- St — - a - 

0.  0 

-U~ - - - .0— — 

0.  0 

“  Vi - o — 

0.  0 

- e-< - o — 

0.  0 

-8-. - g - 

C.  0 

8. - 8 - 

0.  0 

- Ov - g - 

0.  c 


.-■©fAHPtE-PROS  NO  5  5  J  XTAy-COnPLETE/M  REQUIRENENTS-fKANStATTON - 

i 


JJ3GE  5  JCONV  =  0  JUDGE  HEIGHT  =  0.0  JSE  VALUE  LIMIT  : 


TOTAL  N8R  ALT 


16 


NR  THIS  JUDGE  = 


TABLE  D-6.  (Continued) 


lND£«  Itsf  0-  pEIUIPEPEmTS  AMD  PPOJCCTS 


4 

5101. 

*53  -54 

✓ 

2 

P101. 

PGO  -59 

/ 

3 

5101. 

PGC  -66 

/ 

9 

*101. 

PGD  -fl 

/ 

5 

*ltl. 

-52 

/ 

6 

*111- 

PSD  -63 

/ 

7 

Plot. 

PGD  -69 

/ 

9 

5101. 

PGD  -65 

/ 

i 

5101. 

PC3  -65 

/ 

1C 

5101. 

PCD  -67 

/ 

11 

5101. 

PGD  -64 

/ 

12 

9191. 

PGD  -69 

/ 

13 

5141. 

PQ>  -75 

/ 

s 

*101. 

PSD  -71 

- 

15 

*145-.- 

*50—64'  -  / 

16 

*249.  — 

-PE5-42 

17 

5204. 

PE»  -0s. 

/ 

18 

K213. 

PET  -51 

/ 

19 

*?14- 

PET  -53 

/ 

20 

*3C1. 

POS  -61 

/ 

21 

53::. 

PDS  -42 

/ 

22 

5241. 

PES  -01 

/ 

23 

•341. 

PES  -82 

/ 

29 

*361. 

**£S  -09 

/ 

25 

5301. 

PS »  -05 

/ 

26 

5301. 

p-S  -06 

/ 

27 

5301. 

PES  -07 

/ 

24 

*301. 

PCS  -09 

t 

20 

5301. 

PCS  -11 

/ 

3C 

5301. 

PES  -12 

t 

31 

5341. 

PCS  -13 

/ 

32 

*361. 

PES  -15 

/ 

13 

5301. 

PES  -1j 

/ 

39 

5301. 

PET  -95 

✓ 

35 

5301. 

PET  -96 

f 

36 

*341. 

PET  -97 

/ 

— jf— 

u::. 

P£T  -%5 

/ 

38 

*301. 

PET  -95 

t — 39 

—*341. - 

PET— 51— 

t 

%*' 

*341. - 

PET-52 

/ 

41 

5301  • 

orr  .53 

/ 

92 

5301. 

POO  -54 

/ 

93 

5301. 

PGC  -59 

/ 

99 

*301. 

PGO  -60 

/ 

45 

5301. 

°c*»  -6: 

/ 

96 

5301. 

PCD  -62 

/ 

97 

*341. 

PGD  -63 

/ 

96 

*311. 

PGD  -69 

/ 

O 

5301. 

PC')  -65 

/ 

50 

5331. 

PGD  -66 

/ 

51 

*331  • 

PGC  -67 

/ 

52 

*301. 

PGO  -68 

f 

—53 

53C1. 

PCI  -69 

/ 

59 

9301. 

PGD  -70 

t 

55 

*341. 

PCC  -71 

/ 

56 

•  341. 

PGC  -17 

/ 

57 

5301  r 

PGS  -U 

/ 

54 

5301. 

PGG  -19 

/ 

59 

*351. 

PGG  -20 

/ 

68 

*301. 

PGG  -21 

/ 

— 51— 

■*30tv  - 

PGS  -22 

/ 

62 

5301. 

PGG'— 2* 

- 

PGG- -25  - 

i- 

“69-  -P3ti.  - - 

-PGG— 26 

/ 

55 

5301. 

PG ft  -27 

/ 

66 

5331. 

PGG  -28 

/ 

67 

*331. 

PGC  -29 

t 

66 

*301. 

PGG  -30 

/ 

-if’ 

*301. 

pg;  -3i 

/ 

70 

*301. 

PGG  -32 

/ 

71 

*341. 

PGG  -33 

/ 

72 

*341. 

PGG  -39 

/ 

75 

5301. 

PGS  -35 

/ 

79 

5301. 

PGG  -37 

/ 

75 

*301. 

PGG  -36 

/ 

76 

9301. 

PGG  -39 

/ 

—  77“ 

*341. 

PG5  -49 

/ 

74 

*301. 

PGG  -«.l 

f 

79 

•391. 

PGG  -92 

/ 

46 

*341. 

PCC  -9  3 

/ 

41 

5301. 

PCS  -69 

/ 

62 

53.:. 

PKP  -83 

/ 

43 

*331. 

PKP  -66 

/ 

69 

*361. 

PKP  -45 

/ 

- 15- 

-*30t-; — PK*  -45 

/ 

4t 

*301. 

P*P  —69 

- / 

I7-9MMM2  765 — 61- 

f 

-64 

9362.66E2 

POS  —70- 

t- 

45 

5302. 00E2 

PES  -05 

✓ 

90 

5302.00E2 

PES  -07 

/ 

91 

*382.00E2 

PCS  -19 

/ 

92 

*362.0022  *ES  -16 

/ 

—  13“ 

53C2.1IE2 

PCS  -25 

/ 

59 

5302-0062 

PGG  -27 

/ 

95 

4302.44E 2  PCC  -33 

/ 

96 

*362.60E2 

PGG  -36 

/ 

57 

53J3  . 

P£f  -94 

/ 

96 

*333. 

PGG  -32 

/ 

99 

*339. 

PES  -69 

/ 

186 

*389. 

PKP  -83 

/ 

— 1«1“ 

*303.-60* 

POS  -79 

/ 

102 

5315. OOF 

PES  -05 

/ 

163 

*365.007 

pES—67 

/ 

19% 

•365.69F 

PES  -09 

/ 

105  *305. 90r 

HI  i4H  44f- 

PES  -13 

/  146  5305. OOP 

PKP  -67 

✓ 

107 

*305. OOF 

P*P  -90 

/ 

109 

*365.987 

PTP  -91 

113 

*387. 

*  <S  *7. 

PK>  -91 

/ 

119 

*30  7. 

PKP  -93 

/ 

111 

US 

*3ff *  ■“ 
*33  7. 

PKF  -95 

~t~ 

/ 

112-' 

116 

*307 . 
*318.001 

■PKP  -90" 

PES  -16 

— / 

/ 

117 — *310.401' 

PCS  -25 

/ 

US 

5310 .90 1 

PGG  -27 

7 

119 

“*310.001 

PGG  -33 

t 

124- 

*316.061 

PGG  -36 

/ 

121 

5310.00V 

PES  -15 

/ 

122 

*310. 08V 

PGG  -25 

/ 

123 

9313.8CV 

PGC  -77 

i 

129 

*3f 4.46K 

PGG 

/ 

125' 

*St0.80K~PCS  -34 

/ 

126 

*313.909 

PE9C-56 

— / 

127  -*901.906- 

-PES  -'ll  - 

/■ 

120 

*901.666 

•ES  -09 

/ 

129 

54S1.084 

PCS  -C2 

/ 

135 

R9tl.UB 

PES  -55 

/ 

131 

*9ii.o:G 

PES  -02 

t 

132 

*901.0  OC 

PES  -09 

/ 

133- “*441.- 34* 

POS-81 

/ 

139 

*%«t.9ttt 

P«- -82- 

— r- 

— *9tl-.0CH” 

Ptt  -«2  - 

1-136  -*9tl;te*-  PCS  -49 

'  7" 

. 

*401.00* 

PES  -05 

✓ 

136 

5691. OCH 

PET  -96 

/ 

139 

59B1.0DM 

PET  -97 

/ 

190 

R991.06H 

PET  -94 

/ 

,“W“ 

*4Ci:ton 

PET  -53 

✓ 

192 

*501.009 

PCO  -56 

7*153- 

*90r.*3T1 — PCTT-59  — 

-7* 

199* 

*901.66*T 

*CO  -50 

/ 

US 

*4«1.0;* 

PG3  -61 

/ 

*66 

*901.609 

PGD  -62 

/ 

197 

*631 .CC M 

PCC  -63 

/ 

196 

*«01.08H 

PGO  -49 

/ 

u?— 

*441:  Ottt 

PG9  -65 

/ 

150 

*901.009 

PCO  -66 

*9OU00*-PGt  -6T- 

■t 

152- 

*981.4 tH 

PGO  *68 

7 

153 

*401.00* 

PGD  -59 

/ 

159 

5501. OCH 

PGD  -78 

/ 

155 

*401. 00H 

PGC  -71 

/ 

156 

R981.66N 

PGG  -14 

/ 

-137  - 

‘*461 VOO* 

PCS  -24 

/ 

15S 

— t- 

159- 

*68 1.  MM 

PSO  —22  — 

■7- 

166- 

“*9,6lr647t— PGG— 29— 

-7- 

141 

5«i.o;m 

PCS  -26 

/ 

162 

*961.139 

PGG  -29 

/ 

163 

*501. 60M 

PGG  -32 

/ 

169 

*901.08* 

PGG  -39 

✓ 

177  *4*1.001  P£5 

m  *411. 00*  PES 
145  Rt'Qk,  PW 


-e« 

-;2 

-42 

-21 


/ 

170 

R961.38H 

•  .  .  .  -.M 

PCC  -92 

/ 

571 

*961. I0H 

PGG  -93 

/ 

172 

P961.86H 

PGG  -99 

/ 

/ 

**• 

170 

<901*661 

PES  -0% 

“■/  ■ 

/ 

IPS'- 

179 

*90 1  •  3:  h  * 
5481 .BOX 

PES  -02 

-7- 

/ 

126  ■ 
166 

*941.fcOP~ 

R9I1.68K 

PKP  -41 — 
PES  -69 

/ 

/ 

162 

R901.C6M 

PES  -09 

/ 

163 

*492. 

PET  -50 

/ 

169 

*909. 

POS  -72 

/ 

/ 

186 

*«09. 

PGG  -26 

/ 

147 

*999. 

PGG  -29 

/ 

144 

•949. 

PGG  -39 

/ 
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TABLE  D-6.  (Continued) 


189 

’404. 

PG3  -36 

/ 

19G 

34  04. 

PGG 

-40 

/ 

191 

94J4. 

PGG  -42 

/ 

192 

9434. 

PGG  -44 

/ 

193 

9405  • 

PEMG-55 

/ 

194 

3405. 

PEHG-52 

/ 

195 

9631. 

POS  -81 

/ 

196 

9601. 

PDS  -62 

f 

-197 

2601. 

PES  -03 

/ 

196 

3601. 

PES 

-08 

/ 

199 

9601. 

PGG  -23 

/ 

200 

9601. 

**GG  -24 

/ 

201 

R601. 

P<=>  -55 

/ 

202 

9601. 

PKP 

-94 

/ 

203 

’632. 

POS  -25 

/ 

204 

9602. 

POS  -76 

/ 

-20* 

9602. 

POS  -22 

/ 

206 

one. 

_ .  .i  . 

.  1 

P:  7 

pc  1  3  _ 

nr c 

0 

dr  c  «  n 

. 

UCO 

“US 

ov 

f 

-t  f 

*vu  ,‘  £  « 

- / 

"tiiw 

*  nWV  • 

/ 

219 

R602  « 

PET  -54 

/ 

210 

360  3. 

PGO 

-58 

/ 

211 

R633. 

PGG  -59 

t 

212 

9603. 

PGO  -60 

f 

213 

9603. 

PGO  -51 

/ 

214 

R603. 

PGG 

-62 

/ 

215 

9693. 

PGO  -63 

2 

216 

9603. 

PGO  -64 

/ 

212 

R603. 

PGO  -65 

/ 

213 

3603. 

PGO 

-66 

/ 

219 

960  3. 

PGO  -62 

/ 

220 

9603. 

PGO  -69 

/ 

221 

9603. 

PGO  -69 

/ 

222 

36u  3. 

PSD 

-2i 

/ 

223 

963  3. 

PGO  -21 

2 

224 

9604. 

POS  -73 

/ 

225 

9604. 

POS  -24 

/ 

226 

R604. 

POS 

-60 

/ 

222 

9604. 

PES  -03 

2 

228 

9604. 

PES  -14 

/ 

229 

3609. 

-PG9  —23 

/ 

238- 

-3604. 

PGG 

-31 

/- 

231 

—  R606  -  -  - 

- PES — 06 

2 

232 

-''606. 

PES  -37 

/ 

233 

9605. 

PES  -14 

/ 

234 

3602. 

PEHG-56 

/ 

235 

9602. 

PET  -54 

2 

236 

9609. 

PEHG-56 

/ 

232 

9609. 

PES  -09 

/ 

236 

R609. 

PES 

-11 

/ 

239 

9699. 

PET  -49 

2 

243 

9609. 

PET  -54 

/ 

241 

3609. 

PK=>  -63 

/ 

242 

9609. 

PKP 

-94 

/ 

2h3 

9609. 

PKP  -05 

2 

244 

9609. 

PKP  -92 

/ 

245 

9610. 

PET  -50 

/ 

24£ 

9612. 

PGG 

-31 

2 

242 

9612. 

PGG  -41 

2 

248 

9612. 

PGG  -43 

/ 

249 

3615. 

PK3  -93 

/ 

25C 

9616. 

PKP 

-94 

/ 

251 

9701.3 

PGO  -53 

2 

252 

9802. 

PGO  -59 

/ 

253 

3301. 

PK3  -95  - 

/ 

254 

PGG- 

—35-  - 

2 

..  — 

— 

- - 

— 

- 

. 

^EaUl9EHENTS  TO  PROJECTS  TRANSLATION 
4  *  3  >  2>  1*  5  *  7  >  6 
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TA8LK  D-6.  (Continued) 


SU3-U5T  FREUENCT  1ATRIX 

JUDGE  1  1  >  2  >  3>  4  »  5  »  6  > 


1 

2 

3 

4 
~~5 

b 

7 


I 

I 

I 

I 

I— 

I 

I 


1.3 

0,0 

3.3 

0.0 


0.3 

0.0 

n.o 


1.0 

1.0 

0.3 

0.0 


t»*  0 


0  .  j 

0.3 


3.3 

0.3 


1.0 

1.0 

l.C 

0.0 

,b 

0.0 

0.0 


1.0 

1.0 

1.0 

1.0 

5.0 

o.a 

9.0 


EXAMPLE  PROD  NO  5  5J  *7 A.  COMPLETE/*  REQUIREMENTS  TRANSLATION 


1.0 

1.0 

1.0 

1.0 

1.0 

G.O 

0.0 


1.0 

1*0 

1.9 

1.0 


1.0 

0.0 


TABLE  D-6.  (Continued) 


-SUB-LIST  FRE3UEKC7  MATRIX 


EXAMPLE  PR03  NC  5  5 J  X7A,  COMPLETE/H  REQUIREMENTS  TRANSLATION 


-JUDGE  Z 

7  »  2  *  4 

N 

*o 

A 

1  > 

6  > 

c 

-PR-n-T — 

1 

Z  3 

4  - 

5 

6 

7 

~i  I 

c  • . 

C  •  *5 

0*0 

1*0 

1.0 

0.0 

2  X 

1.0 

0.0  1.0 

.5 

1.0 

1.0 

0.0 

- 5  I 

•  5 

0.0  0.0 

0.0 

1.0 

1.0 

0.0 

4  I 

1.0 

.5  1.0 

0.0 

1.0 

1.0 

0.  0 

I 

0.0 

0.-  f.i 

c  «  C 

X  .0 

U  •  v 

(?  4t 

&  I 

0.0 

0.3  0.0 

0.0 

1.0 

0.0 

0.0 

-  7  I 

1.0 

1.0  1.9 

l.C 

1.0 

1.0 

o.-o 

n 


•jaE 

K* - 


j 


1 


TABLE  D-6.  (Continued) 


SOB-tlST  F«?Ea'JENCv  MATRIX 


EXAMPLE  PROS  NO  5  5J  X7A,  COMPt€TE/M  REQUIREMENTS  TRANSLATION 


■rfOOGE  3 


3  >  4  =  5*  6=  7  >  1  >  2 


1  -  ^ — 


— H - 5 - $ - 7 


6  I  1.0  1.0  0.0  0.0  0.0  0.0  .5 

7  I  1.0  1.0  OiO  O.-fl  0.0  ~~»5 Ovfl —  - 
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TABLE  D-6.  (Continued) 


-s«8-tts t - f Rtaue n; r 

MATRIX 

EXAMPLE  PR09  NO  5  5J  X7A,  COMPLETE/H  REQUIREMENTS 

TRANSLATION 

57tyt7tjfc  H 

1  > 

7  *  6 

*  2 

»  3  * 

4  > 

5 

PROJ - 

— 1  - 

—  2 — 

_ 5_.  . 

---4— 

- 5  — 

_ _ 6 _ 

7  _ 

- i — I — 

0.8 

X. 

1.0 

1.0 

1.0 

1.0 

- -1.0  -  -  - 

2  I 

0.0 

0.0 

1.0 

1.0 

1.0 

.5 

0.0 

- 3  I 

0.0 

0.0 

0.0 

.5 

1.0 

O.fl 

0.0  ■  -  ~  -  ---- 

4  I 

- 5—1 - 

0.0 

0*3 

b-w 

.5 

- j-,--— 

0.0 

1.0 

- 0.0 

1.0 

0*0 

0.0 

6  I 

0.0 

•  5 

1.0 

1.0 

0.0 

0.0 

— 

— ?  I  -  - 

— i-*0 

l^rO 

1.0 

1.0 

1.0- 

-0*<h-  - -  -  -  - -  - -  - — _ . ... 
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TABLE  D-6.  (Continued) 


~EXAHPl£  PROg  NO  5  50-^At-G0MPL€T£/M~REQUIRENENTS  TRAN  SLAT 


f' 


Pi 


TABLE  D-6.  (Continued) 


COMPUTED  PREFERENCE  MATRIX  EXAMPLE  PROS  NO  5  5J  X7A,  COMPLETE/M  REQUIREMENTS  TRANSLATION 

SUM  1  2  3  4  5  6  7 


“•o  i  I  o.a  i.o  .5  u.a  i.o  i-.-e  .5 

3*5  ^  I  0.0  0.0  1 .  Q  .5  1.0  1.0  0.0 

H. 5  31  .5  0.0  0.0  1.0  1.0  1.9  1.0 

<*.5  I  1.0  .5  0.0  0.0  1.  0  1.0  1.0 

I. 5  5  I  0.0  0.0  0.0  0.0  0.0  1.0  .5 

»  •  •  ol  0*.  } . j  0..  c . C  0*0  0.0  0.0 

3.0  71  .5  1.0  0.0  0.0  .5  1.0  0.0 


P?EF  3=  ->  1>  2  *  7  »  5  >  6 

NJMSE'r  OF  fractional  3'JiS=  •. 


LONER 

N= 

7  <cNOALL  O  = 

<*.  00 

ZETA  = 

.71 1*3 

PF08 

THAT 

RANK 

ORDER 

NOT 

CONSISTANT  = 

. 0  333571a 

RANK  ORDER 
RANK  ORDER 

NOT 

COnSTSTAnT  AT  .05  LEVEL 

consistant  at  .(.i  level 

Ua3ER 

N= 

7  KENOALL  O  = 

6.  00 

ZETA  = 

•  5  7l<* 

PROS 

THAT 

RANK 

OROFR 

NOT 

CCNSIST  A  NT  * 

.1126925*. 

RANK  ORDER 
RANK  OROER 

NOT 

NOT 

CONSIST  ANT  AT  .05  LEVEL 
CONSISTANT  AT  .Ci  LEVEL 

AVERAGE 

N  = 

7  KENDALL  0  = 

5.  00 

ZETA  = 

•  S<*?9 

PROS 

THAT 

RANK 

ORDER 

HOT 

CONSISTANT  = 

.0690965? 

RANK  ORDER  NDT  CONSISTANT  AT  .05  LEVEL 
RANK  ORDER  NOT  CONSISTANT  AT  .01  LEVEL 
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TABLE  D-6.  (Continued) 


CONCORDANCE  SUMMARY  BY  r.LEMtNT  -YAFFLE  P»OT  NO  5  5j  <7 

JNWEIGHTE 0  SU3LISr$ 

—  -  17  3  4  5c7 

JUDGE  - 

ADJ  B3RQA  I  -3*0  *»Q  —  l.-J —  2.G  6.u  7..  ?«■/ 

PREF  X  3.3  4.0  1.5  1.5  6.0  7.0  5.3 


R<  J) 


6.3  6.3  2.5  3.5  12.0  14. 0  10.0 


MEAN 


8.00  S  JM  OF  DEVIATIONS  SQUARED  =  113.5. 


SUM  T  =  .50 


KENOALLS  COEFICIENT  OF  CONCORDANCE 


.955 


M  =  2  N  =  7 


RANK  ORDER  CONSISTANT  AT  .35  LEVEL.  CRITICAL  S  = 
RANK  ORDER —  -OOVSf-SJ+NT—AT  -  ^frl  LEVEL.  CRITICAL  S  = 


97.00 

ISVcOfl- 


Ei ,  - 
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